Nov 04 07:14:42.818821 ip-10-0-130-91 systemd[1]: Starting Kubernetes Kubelet... Nov 04 07:14:43.135411 ip-10-0-130-91 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 07:14:43.135411 ip-10-0-130-91 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 04 07:14:43.135411 ip-10-0-130-91 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 07:14:43.135411 ip-10-0-130-91 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 07:14:43.138818 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138746 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 07:14:43.138818 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138817 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 07:14:43.138818 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138821 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 07:14:43.138916 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138824 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 07:14:43.138916 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138828 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 07:14:43.138916 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138832 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 07:14:43.138916 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138834 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 07:14:43.138916 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138838 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 07:14:43.138916 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138841 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 07:14:43.138916 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138843 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 07:14:43.138916 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138846 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 07:14:43.138916 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138849 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 07:14:43.138916 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138851 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 07:14:43.138916 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138854 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 07:14:43.138916 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138856 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 07:14:43.138916 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138859 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 07:14:43.138916 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138861 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 07:14:43.138916 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138864 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 07:14:43.138916 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138872 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 07:14:43.138916 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138875 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 07:14:43.138916 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138878 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 07:14:43.138916 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138880 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 07:14:43.139357 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138883 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 07:14:43.139357 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138885 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 04 07:14:43.139357 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138888 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 07:14:43.139357 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138891 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 07:14:43.139357 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138894 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 07:14:43.139357 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138896 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 07:14:43.139357 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138899 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 07:14:43.139357 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138903 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 07:14:43.139357 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138907 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 07:14:43.139357 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138910 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 07:14:43.139357 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138913 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 07:14:43.139357 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138915 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 07:14:43.139357 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138918 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 07:14:43.139357 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138921 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 07:14:43.139357 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138924 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 07:14:43.139357 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138927 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 07:14:43.139357 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138929 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 07:14:43.139357 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138932 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 07:14:43.139357 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138934 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 07:14:43.139803 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138937 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 07:14:43.139803 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138940 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 07:14:43.139803 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138942 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 07:14:43.139803 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138944 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 07:14:43.139803 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138947 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 07:14:43.139803 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138949 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 07:14:43.139803 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138953 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 07:14:43.139803 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138956 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 07:14:43.139803 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138958 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 07:14:43.139803 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138961 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 07:14:43.139803 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138963 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 07:14:43.139803 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138965 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 07:14:43.139803 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138968 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 07:14:43.139803 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138971 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 07:14:43.139803 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138974 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 07:14:43.139803 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138977 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 07:14:43.139803 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138980 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 07:14:43.139803 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138982 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 07:14:43.139803 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138985 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 07:14:43.139803 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138987 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 07:14:43.140264 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138990 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 07:14:43.140264 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138993 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 07:14:43.140264 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138995 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 07:14:43.140264 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.138998 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 07:14:43.140264 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139000 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 07:14:43.140264 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139003 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 07:14:43.140264 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139005 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 07:14:43.140264 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139008 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 07:14:43.140264 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139010 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 07:14:43.140264 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139012 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 07:14:43.140264 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139015 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 07:14:43.140264 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139018 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 07:14:43.140264 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139020 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 07:14:43.140264 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139023 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 07:14:43.140264 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139026 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 07:14:43.140264 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139028 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 07:14:43.140264 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139031 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 07:14:43.140264 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139033 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 07:14:43.140264 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139036 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 07:14:43.140728 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139038 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 07:14:43.140728 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139041 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 07:14:43.140728 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139043 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 07:14:43.140728 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139046 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 07:14:43.140728 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139048 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 07:14:43.140728 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139050 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 07:14:43.140728 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139053 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 07:14:43.140728 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139057 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 07:14:43.140728 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139059 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 07:14:43.140728 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139062 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 07:14:43.140728 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139064 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 07:14:43.140728 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139067 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 07:14:43.140728 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139069 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 07:14:43.140728 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139072 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 07:14:43.140728 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139075 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 07:14:43.140728 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139077 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 07:14:43.140728 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139079 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 07:14:43.140728 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139082 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 07:14:43.140728 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139084 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 07:14:43.140728 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139088 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 07:14:43.141219 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139091 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 07:14:43.141219 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139094 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 07:14:43.141219 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139097 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 07:14:43.141219 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139100 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 07:14:43.141219 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139103 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 07:14:43.141219 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139106 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 07:14:43.141219 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139879 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 07:14:43.141219 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139887 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 07:14:43.141219 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139891 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 07:14:43.141219 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139894 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 07:14:43.141219 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139897 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 07:14:43.141219 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139899 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 07:14:43.141219 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139902 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 07:14:43.141219 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139905 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 07:14:43.141219 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139908 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 07:14:43.141219 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139910 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 07:14:43.141219 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139913 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 07:14:43.141219 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139915 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 07:14:43.141219 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139919 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 07:14:43.141706 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139921 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 07:14:43.141706 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139924 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 07:14:43.141706 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139926 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 07:14:43.141706 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139929 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 07:14:43.141706 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139932 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 07:14:43.141706 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139934 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 07:14:43.141706 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139937 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 07:14:43.141706 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139939 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 07:14:43.141706 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139942 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 07:14:43.141706 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139945 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 07:14:43.141706 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139947 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 07:14:43.141706 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139950 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 07:14:43.141706 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139952 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 07:14:43.141706 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139955 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 07:14:43.141706 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139957 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 07:14:43.141706 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139959 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 07:14:43.141706 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139962 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 07:14:43.141706 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139966 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 07:14:43.141706 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139970 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 07:14:43.142150 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139974 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 07:14:43.142150 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139977 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 07:14:43.142150 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139981 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 07:14:43.142150 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139984 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 07:14:43.142150 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139987 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 07:14:43.142150 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139989 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 07:14:43.142150 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139992 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 07:14:43.142150 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139995 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 07:14:43.142150 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.139998 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 07:14:43.142150 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140000 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 07:14:43.142150 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140003 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 07:14:43.142150 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140005 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 07:14:43.142150 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140008 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 07:14:43.142150 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140010 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 07:14:43.142150 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140013 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 07:14:43.142150 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140016 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 07:14:43.142150 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140018 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 07:14:43.142150 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140021 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 07:14:43.142150 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140023 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 07:14:43.142150 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140026 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 07:14:43.142713 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140028 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 07:14:43.142713 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140031 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 07:14:43.142713 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140034 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 07:14:43.142713 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140036 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 07:14:43.142713 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140039 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 07:14:43.142713 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140042 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 07:14:43.142713 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140045 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 07:14:43.142713 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140047 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 07:14:43.142713 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140050 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 07:14:43.142713 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140052 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 07:14:43.142713 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140055 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 07:14:43.142713 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140058 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 07:14:43.142713 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140060 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 07:14:43.142713 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140063 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 04 07:14:43.142713 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140065 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 07:14:43.142713 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140068 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 07:14:43.142713 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140071 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 07:14:43.142713 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140074 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 07:14:43.142713 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140076 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 07:14:43.142713 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140079 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 07:14:43.143192 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140081 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 07:14:43.143192 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140084 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 07:14:43.143192 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140086 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 07:14:43.143192 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140088 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 07:14:43.143192 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140091 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 07:14:43.143192 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140094 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 07:14:43.143192 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140096 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 07:14:43.143192 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140099 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 07:14:43.143192 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140101 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 07:14:43.143192 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140103 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 07:14:43.143192 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140106 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 07:14:43.143192 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140108 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 07:14:43.143192 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140111 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 07:14:43.143192 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140113 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 07:14:43.143192 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140116 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 07:14:43.143192 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140118 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 07:14:43.143192 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140123 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 07:14:43.143192 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140125 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 07:14:43.143192 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140128 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 07:14:43.143652 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140130 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 07:14:43.143652 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140133 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 07:14:43.143652 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140136 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 07:14:43.143652 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140139 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 07:14:43.143652 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140141 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 07:14:43.143652 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140144 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 07:14:43.143652 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140146 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 07:14:43.143652 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140149 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 07:14:43.143652 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140151 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 07:14:43.143652 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140155 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 07:14:43.143652 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140157 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 07:14:43.143652 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140160 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 07:14:43.143652 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140164 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 07:14:43.143652 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140169 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 07:14:43.143652 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140172 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 07:14:43.143652 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140658 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 07:14:43.143652 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140665 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 07:14:43.143652 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140668 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 07:14:43.143652 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140672 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 07:14:43.144102 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140675 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 07:14:43.144102 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140677 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 07:14:43.144102 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140680 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 07:14:43.144102 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140683 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 07:14:43.144102 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140686 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 07:14:43.144102 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140688 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 07:14:43.144102 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140691 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 07:14:43.144102 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140693 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 07:14:43.144102 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140696 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 07:14:43.144102 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140699 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 07:14:43.144102 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140704 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 07:14:43.144102 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140706 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 07:14:43.144102 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140709 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 07:14:43.144102 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140711 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 07:14:43.144102 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140715 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 07:14:43.144102 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140719 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 07:14:43.144102 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140722 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 07:14:43.144102 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140725 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 07:14:43.144102 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140727 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 07:14:43.144555 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140730 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 07:14:43.144555 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140733 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 07:14:43.144555 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140736 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 07:14:43.144555 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140739 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 07:14:43.144555 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140742 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 07:14:43.144555 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140745 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 07:14:43.144555 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140747 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 07:14:43.144555 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140750 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 07:14:43.144555 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140752 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 07:14:43.144555 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140754 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 07:14:43.144555 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140757 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 07:14:43.144555 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140759 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 07:14:43.144555 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140762 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 07:14:43.144555 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140765 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 07:14:43.144555 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140767 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 07:14:43.144555 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140770 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 07:14:43.144555 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140772 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 07:14:43.144555 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140774 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 07:14:43.144555 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140777 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 07:14:43.144555 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140779 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 07:14:43.145028 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140782 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 07:14:43.145028 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140784 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 07:14:43.145028 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140787 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 07:14:43.145028 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140791 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 07:14:43.145028 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140793 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 07:14:43.145028 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140796 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 07:14:43.145028 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140799 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 07:14:43.145028 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140801 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 07:14:43.145028 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140803 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 07:14:43.145028 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140806 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 07:14:43.145028 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140809 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 07:14:43.145028 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140811 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 07:14:43.145028 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140814 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 07:14:43.145028 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140816 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 07:14:43.145028 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140819 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 07:14:43.145028 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140821 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 07:14:43.145028 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140824 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 07:14:43.145028 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140827 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 04 07:14:43.145028 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140829 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 07:14:43.145028 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140831 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 07:14:43.145493 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140834 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 07:14:43.145493 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140837 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 07:14:43.145493 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140839 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 07:14:43.145493 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140841 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 07:14:43.145493 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140844 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 07:14:43.145493 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140846 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 07:14:43.145493 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140849 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 07:14:43.145493 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140851 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 07:14:43.145493 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140854 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 07:14:43.145493 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140856 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 07:14:43.145493 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140859 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 07:14:43.145493 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140862 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 07:14:43.145493 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140864 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 07:14:43.145493 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140867 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 07:14:43.145493 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140869 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 07:14:43.145493 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140873 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 07:14:43.145493 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140875 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 07:14:43.145493 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140878 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 07:14:43.145493 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140880 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 07:14:43.145984 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140883 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 07:14:43.145984 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140885 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 07:14:43.145984 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140888 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 07:14:43.145984 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140890 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 07:14:43.145984 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140893 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 07:14:43.145984 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140897 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 07:14:43.145984 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140901 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 07:14:43.145984 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140905 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 07:14:43.145984 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140908 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 07:14:43.145984 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140911 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 07:14:43.145984 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140915 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 07:14:43.145984 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140918 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 07:14:43.145984 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140921 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 07:14:43.145984 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140925 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 07:14:43.145984 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140927 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 07:14:43.145984 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140929 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 07:14:43.145984 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140932 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 07:14:43.145984 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140934 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 07:14:43.145984 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140937 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 07:14:43.146419 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140939 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 07:14:43.146419 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140942 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 07:14:43.146419 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140944 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 07:14:43.146419 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140946 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 07:14:43.146419 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.140949 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 07:14:43.146419 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141743 2576 flags.go:64] FLAG: --address="0.0.0.0" Nov 04 07:14:43.146419 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141752 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 04 07:14:43.146419 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141758 2576 flags.go:64] FLAG: --anonymous-auth="true" Nov 04 07:14:43.146419 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141762 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 04 07:14:43.146419 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141767 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 04 07:14:43.146419 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141770 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 04 07:14:43.146419 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141775 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 04 07:14:43.146419 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141778 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 04 07:14:43.146419 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141782 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 04 07:14:43.146419 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141785 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 04 07:14:43.146419 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141789 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 04 07:14:43.146419 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141792 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 04 07:14:43.146419 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141795 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 04 07:14:43.146419 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141798 2576 flags.go:64] FLAG: --cgroup-root="" Nov 04 07:14:43.146419 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141801 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 04 07:14:43.146419 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141804 2576 flags.go:64] FLAG: --client-ca-file="" Nov 04 07:14:43.146419 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141806 2576 flags.go:64] FLAG: --cloud-provider="external" Nov 04 07:14:43.146419 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141809 2576 flags.go:64] FLAG: --cluster-dns="[]" Nov 04 07:14:43.146419 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141814 2576 flags.go:64] FLAG: --cluster-domain="" Nov 04 07:14:43.147037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141817 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 04 07:14:43.147037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141821 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 04 07:14:43.147037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141824 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 04 07:14:43.147037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141827 2576 flags.go:64] FLAG: --container-log-max-files="5" Nov 04 07:14:43.147037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141831 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 04 07:14:43.147037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141834 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 04 07:14:43.147037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141837 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 04 07:14:43.147037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141841 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 04 07:14:43.147037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141844 2576 flags.go:64] FLAG: --contention-profiling="false" Nov 04 07:14:43.147037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141847 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 04 07:14:43.147037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141850 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 04 07:14:43.147037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141853 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 04 07:14:43.147037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141856 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 04 07:14:43.147037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141861 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 04 07:14:43.147037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141864 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 04 07:14:43.147037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141867 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 04 07:14:43.147037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141870 2576 flags.go:64] FLAG: --enable-load-reader="false" Nov 04 07:14:43.147037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141873 2576 flags.go:64] FLAG: --enable-server="true" Nov 04 07:14:43.147037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141876 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 04 07:14:43.147037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141880 2576 flags.go:64] FLAG: --event-burst="100" Nov 04 07:14:43.147037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141883 2576 flags.go:64] FLAG: --event-qps="50" Nov 04 07:14:43.147037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141886 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 04 07:14:43.147037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141889 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 04 07:14:43.147037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141892 2576 flags.go:64] FLAG: --eviction-hard="" Nov 04 07:14:43.147724 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141896 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 04 07:14:43.147724 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141899 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 04 07:14:43.147724 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141903 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 04 07:14:43.147724 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141906 2576 flags.go:64] FLAG: --eviction-soft="" Nov 04 07:14:43.147724 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141909 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 04 07:14:43.147724 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141912 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 04 07:14:43.147724 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141915 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 04 07:14:43.147724 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141918 2576 flags.go:64] FLAG: --experimental-mounter-path="" Nov 04 07:14:43.147724 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141921 2576 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 04 07:14:43.147724 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141924 2576 flags.go:64] FLAG: --fail-swap-on="true" Nov 04 07:14:43.147724 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141927 2576 flags.go:64] FLAG: --feature-gates="" Nov 04 07:14:43.147724 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141931 2576 flags.go:64] FLAG: --file-check-frequency="20s" Nov 04 07:14:43.147724 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141934 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 04 07:14:43.147724 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141937 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 04 07:14:43.147724 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141941 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 04 07:14:43.147724 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141944 2576 flags.go:64] FLAG: --healthz-port="10248" Nov 04 07:14:43.147724 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141947 2576 flags.go:64] FLAG: --help="false" Nov 04 07:14:43.147724 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141950 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:14:43.147724 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141953 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 04 07:14:43.147724 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141960 2576 flags.go:64] FLAG: --http-check-frequency="20s" Nov 04 07:14:43.147724 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141963 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 04 07:14:43.147724 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141966 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 04 07:14:43.147724 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141970 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141974 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141977 2576 flags.go:64] FLAG: --image-service-endpoint="" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141980 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141982 2576 flags.go:64] FLAG: --kube-api-burst="100" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141985 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141988 2576 flags.go:64] FLAG: --kube-api-qps="50" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141991 2576 flags.go:64] FLAG: --kube-reserved="" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141994 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.141997 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142000 2576 flags.go:64] FLAG: --kubelet-cgroups="" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142003 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142005 2576 flags.go:64] FLAG: --lock-file="" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142008 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142011 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142014 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142019 2576 flags.go:64] FLAG: --log-json-split-stream="false" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142022 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142025 2576 flags.go:64] FLAG: --log-text-split-stream="false" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142028 2576 flags.go:64] FLAG: --logging-format="text" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142031 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142034 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142037 2576 flags.go:64] FLAG: --manifest-url="" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142040 2576 flags.go:64] FLAG: --manifest-url-header="" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142044 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 04 07:14:43.148748 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142047 2576 flags.go:64] FLAG: --max-open-files="1000000" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142051 2576 flags.go:64] FLAG: --max-pods="110" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142054 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142057 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142060 2576 flags.go:64] FLAG: --memory-manager-policy="None" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142064 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142067 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142071 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142074 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142081 2576 flags.go:64] FLAG: --node-status-max-images="50" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142084 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142087 2576 flags.go:64] FLAG: --oom-score-adj="-999" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142089 2576 flags.go:64] FLAG: --pod-cidr="" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142092 2576 flags.go:64] FLAG: --pod-manifest-path="" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142095 2576 flags.go:64] FLAG: --pod-max-pids="-1" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142098 2576 flags.go:64] FLAG: --pods-per-core="0" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142101 2576 flags.go:64] FLAG: --port="10250" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142104 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142107 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-0623a036c904b4706" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142110 2576 flags.go:64] FLAG: --qos-reserved="" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142113 2576 flags.go:64] FLAG: --read-only-port="10255" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142116 2576 flags.go:64] FLAG: --register-node="true" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142119 2576 flags.go:64] FLAG: --register-with-taints="" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142123 2576 flags.go:64] FLAG: --registry-burst="10" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142126 2576 flags.go:64] FLAG: --registry-qps="5" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142129 2576 flags.go:64] FLAG: --reserved-cpus="" Nov 04 07:14:43.149811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142131 2576 flags.go:64] FLAG: --reserved-memory="" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142135 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142139 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142142 2576 flags.go:64] FLAG: --rotate-certificates="false" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142145 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142148 2576 flags.go:64] FLAG: --runonce="false" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142151 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142155 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142159 2576 flags.go:64] FLAG: --seccomp-default="false" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142162 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142165 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142170 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142173 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142177 2576 flags.go:64] FLAG: --storage-driver-password="root" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142180 2576 flags.go:64] FLAG: --storage-driver-secure="false" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142183 2576 flags.go:64] FLAG: --storage-driver-table="stats" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142186 2576 flags.go:64] FLAG: --storage-driver-user="root" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142189 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142192 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142195 2576 flags.go:64] FLAG: --system-cgroups="" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142198 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142203 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142206 2576 flags.go:64] FLAG: --tls-cert-file="" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142209 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142213 2576 flags.go:64] FLAG: --tls-min-version="" Nov 04 07:14:43.150983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142216 2576 flags.go:64] FLAG: --tls-private-key-file="" Nov 04 07:14:43.151624 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142219 2576 flags.go:64] FLAG: --topology-manager-policy="none" Nov 04 07:14:43.151624 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142221 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 04 07:14:43.151624 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142224 2576 flags.go:64] FLAG: --topology-manager-scope="container" Nov 04 07:14:43.151624 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142227 2576 flags.go:64] FLAG: --v="2" Nov 04 07:14:43.151624 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142231 2576 flags.go:64] FLAG: --version="false" Nov 04 07:14:43.151624 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142235 2576 flags.go:64] FLAG: --vmodule="" Nov 04 07:14:43.151624 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142239 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 04 07:14:43.151624 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142242 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 04 07:14:43.151624 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142385 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 07:14:43.151624 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142390 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 07:14:43.151624 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142394 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 07:14:43.151624 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142397 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 07:14:43.151624 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142400 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 07:14:43.151624 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142404 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 07:14:43.151624 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142407 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 07:14:43.151624 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142409 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 07:14:43.151624 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142412 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 07:14:43.151624 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142417 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 07:14:43.151624 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142419 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 07:14:43.151624 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142422 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 07:14:43.151624 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142424 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 07:14:43.151624 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142427 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 04 07:14:43.152538 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142429 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 07:14:43.152538 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142432 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 07:14:43.152538 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142434 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 07:14:43.152538 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142437 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 07:14:43.152538 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142439 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 07:14:43.152538 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142442 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 07:14:43.152538 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142445 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 07:14:43.152538 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142448 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 07:14:43.152538 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142451 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 07:14:43.152538 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142453 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 07:14:43.152538 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142456 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 07:14:43.152538 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142458 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 07:14:43.152538 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142460 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 07:14:43.152538 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142463 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 07:14:43.152538 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142466 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 07:14:43.152538 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142468 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 07:14:43.152538 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142471 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 07:14:43.152538 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142474 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 07:14:43.152538 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142476 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 07:14:43.153268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142479 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 07:14:43.153268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142482 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 07:14:43.153268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142484 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 07:14:43.153268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142487 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 07:14:43.153268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142491 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 07:14:43.153268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142493 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 07:14:43.153268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142496 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 07:14:43.153268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142498 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 07:14:43.153268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142510 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 07:14:43.153268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142513 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 07:14:43.153268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142515 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 07:14:43.153268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142518 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 07:14:43.153268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142520 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 07:14:43.153268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142523 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 07:14:43.153268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142525 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 07:14:43.153268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142528 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 07:14:43.153268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142531 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 07:14:43.153268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142533 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 07:14:43.153268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142536 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 07:14:43.153268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142539 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 07:14:43.154079 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142554 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 07:14:43.154079 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142557 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 07:14:43.154079 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142559 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 07:14:43.154079 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142562 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 07:14:43.154079 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142565 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 07:14:43.154079 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142568 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 07:14:43.154079 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142570 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 07:14:43.154079 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142573 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 07:14:43.154079 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142575 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 07:14:43.154079 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142578 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 07:14:43.154079 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142580 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 07:14:43.154079 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142583 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 07:14:43.154079 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142586 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 07:14:43.154079 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142588 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 07:14:43.154079 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142591 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 07:14:43.154079 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142594 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 07:14:43.154079 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142600 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 07:14:43.154079 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142604 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 07:14:43.154519 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142607 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 07:14:43.154519 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142610 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 07:14:43.154519 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142615 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 07:14:43.154519 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142618 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 07:14:43.154519 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142620 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 07:14:43.154519 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142623 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 07:14:43.154519 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142626 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 07:14:43.154519 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142629 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 07:14:43.154519 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142632 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 07:14:43.154519 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142634 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 07:14:43.154519 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142637 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 07:14:43.154519 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142639 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 07:14:43.154519 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142642 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 07:14:43.154519 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142645 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 07:14:43.154519 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142648 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 07:14:43.154519 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142650 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 07:14:43.154519 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142653 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 07:14:43.154519 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142655 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 07:14:43.154519 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142658 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 07:14:43.154519 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142661 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 07:14:43.155068 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142665 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 07:14:43.155068 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142669 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 07:14:43.155068 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142671 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 07:14:43.155068 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142674 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 07:14:43.155068 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142677 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 07:14:43.155068 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142679 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 07:14:43.155068 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142682 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 07:14:43.155068 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142684 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 07:14:43.155068 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142687 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 07:14:43.155068 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142690 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 07:14:43.155068 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142693 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 07:14:43.155068 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142696 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 07:14:43.155068 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142699 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 07:14:43.155068 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142701 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 07:14:43.155068 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142705 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 07:14:43.155068 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.142731 2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 07:14:43.155448 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142763 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 07:14:43.155448 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142772 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 07:14:43.155448 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142775 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 07:14:43.155448 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142777 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 07:14:43.155448 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142780 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 07:14:43.155448 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142783 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 07:14:43.155448 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142785 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 07:14:43.155448 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142798 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 07:14:43.155448 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142803 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 07:14:43.155448 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142806 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 07:14:43.155448 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142809 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 07:14:43.155448 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142811 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 07:14:43.155448 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142814 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 07:14:43.155448 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142817 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 07:14:43.155448 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142819 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 07:14:43.155448 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142823 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 07:14:43.155448 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142827 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 07:14:43.155448 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142830 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 07:14:43.155448 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142833 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 07:14:43.155899 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142835 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 07:14:43.155899 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142838 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 07:14:43.155899 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142841 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 07:14:43.155899 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142843 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 07:14:43.155899 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142846 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 07:14:43.155899 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142848 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 07:14:43.155899 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142851 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 07:14:43.155899 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142855 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 07:14:43.155899 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142858 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 07:14:43.155899 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142860 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 07:14:43.155899 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142863 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 07:14:43.155899 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142865 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 07:14:43.155899 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142869 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 07:14:43.155899 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142872 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 07:14:43.155899 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142874 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 07:14:43.155899 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142877 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 07:14:43.155899 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142880 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 07:14:43.155899 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142882 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 07:14:43.155899 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142885 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 07:14:43.155899 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142887 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 07:14:43.156354 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142890 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 07:14:43.156354 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142892 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 07:14:43.156354 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142895 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 07:14:43.156354 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142897 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 07:14:43.156354 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142900 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 04 07:14:43.156354 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142902 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 07:14:43.156354 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142905 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 07:14:43.156354 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142907 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 07:14:43.156354 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142910 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 07:14:43.156354 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142912 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 07:14:43.156354 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142915 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 07:14:43.156354 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142917 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 07:14:43.156354 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142920 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 07:14:43.156354 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142922 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 07:14:43.156354 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142925 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 07:14:43.156354 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142927 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 07:14:43.156354 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142930 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 07:14:43.156354 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142932 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 07:14:43.156354 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142935 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 07:14:43.156354 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142939 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 07:14:43.156875 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142942 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 07:14:43.156875 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142945 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 07:14:43.156875 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142948 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 07:14:43.156875 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142950 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 07:14:43.156875 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142954 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 07:14:43.156875 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142957 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 07:14:43.156875 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142959 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 07:14:43.156875 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142962 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 07:14:43.156875 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142964 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 07:14:43.156875 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142967 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 07:14:43.156875 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142969 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 07:14:43.156875 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142972 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 07:14:43.156875 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142975 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 07:14:43.156875 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142977 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 07:14:43.156875 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142980 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 07:14:43.156875 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142982 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 07:14:43.156875 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142985 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 07:14:43.156875 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142987 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 07:14:43.156875 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142990 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 07:14:43.157366 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142992 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 07:14:43.157366 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142995 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 07:14:43.157366 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.142997 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 07:14:43.157366 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143000 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 07:14:43.157366 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143002 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 07:14:43.157366 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143004 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 07:14:43.157366 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143007 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 07:14:43.157366 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143010 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 07:14:43.157366 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143012 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 07:14:43.157366 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143015 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 07:14:43.157366 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143018 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 07:14:43.157366 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143020 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 07:14:43.157366 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143024 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 07:14:43.157366 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143026 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 07:14:43.157366 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143029 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 07:14:43.157366 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143032 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 07:14:43.157366 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143034 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 07:14:43.157366 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143038 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 07:14:43.157366 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143041 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 07:14:43.157820 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143043 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 07:14:43.157820 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143046 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 07:14:43.157820 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143050 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 07:14:43.157820 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143053 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 07:14:43.157820 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143056 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 07:14:43.157820 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143059 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 07:14:43.157820 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143061 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 07:14:43.157820 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143064 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 07:14:43.157820 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.143067 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 07:14:43.157820 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.150881 2576 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 04 07:14:43.157820 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.150899 2576 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 04 07:14:43.157820 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.151564 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 04 07:14:43.157820 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.151575 2576 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 04 07:14:43.157820 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151682 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 07:14:43.157820 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151689 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 07:14:43.157820 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151694 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 07:14:43.157820 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151700 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 07:14:43.157820 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151704 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 07:14:43.157820 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151708 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 07:14:43.158267 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151712 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 07:14:43.158267 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151717 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 07:14:43.158267 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151721 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 07:14:43.158267 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151725 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 07:14:43.158267 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151731 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 07:14:43.158267 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151738 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 07:14:43.158267 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151743 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 07:14:43.158267 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151748 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 07:14:43.158267 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151752 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 07:14:43.158267 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151757 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 07:14:43.158267 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151761 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 07:14:43.158267 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151766 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 07:14:43.158267 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151770 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 07:14:43.158267 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151774 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 07:14:43.158267 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151779 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 07:14:43.158267 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151783 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 07:14:43.158267 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151787 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 07:14:43.158267 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151791 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 07:14:43.158267 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151796 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 07:14:43.158267 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151800 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 07:14:43.158761 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151804 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 07:14:43.158761 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151808 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 07:14:43.158761 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151812 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 07:14:43.158761 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151829 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 07:14:43.158761 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151834 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 07:14:43.158761 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151838 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 07:14:43.158761 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151842 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 07:14:43.158761 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151847 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 07:14:43.158761 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151851 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 07:14:43.158761 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151855 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 07:14:43.158761 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151860 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 07:14:43.158761 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151864 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 07:14:43.158761 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151868 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 07:14:43.158761 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151872 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 07:14:43.158761 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151876 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 07:14:43.158761 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151880 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 07:14:43.158761 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151885 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 07:14:43.158761 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151889 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 07:14:43.158761 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151893 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 07:14:43.159226 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151898 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 07:14:43.159226 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151902 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 07:14:43.159226 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151907 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 07:14:43.159226 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151911 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 07:14:43.159226 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151915 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 07:14:43.159226 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151920 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 07:14:43.159226 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151924 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 07:14:43.159226 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151929 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 07:14:43.159226 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151933 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 07:14:43.159226 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151937 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 07:14:43.159226 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151941 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 07:14:43.159226 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151946 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 07:14:43.159226 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151950 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 07:14:43.159226 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151954 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 07:14:43.159226 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151959 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 07:14:43.159226 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151964 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 07:14:43.159226 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151968 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 07:14:43.159226 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151981 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 07:14:43.159226 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151985 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 07:14:43.159226 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151990 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 07:14:43.159717 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151994 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 07:14:43.159717 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.151998 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 07:14:43.159717 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152002 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 07:14:43.159717 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152007 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 07:14:43.159717 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152011 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 07:14:43.159717 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152015 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 07:14:43.159717 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152019 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 07:14:43.159717 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152023 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 07:14:43.159717 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152028 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 07:14:43.159717 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152033 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 07:14:43.159717 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152037 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 07:14:43.159717 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152041 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 07:14:43.159717 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152045 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 07:14:43.159717 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152049 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 07:14:43.159717 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152053 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 07:14:43.159717 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152057 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 07:14:43.159717 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152062 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 07:14:43.159717 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152066 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 07:14:43.159717 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152071 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 07:14:43.159717 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152075 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 07:14:43.160252 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152079 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 07:14:43.160252 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152083 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 04 07:14:43.160252 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152087 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 07:14:43.160252 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152092 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 07:14:43.160252 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152099 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 07:14:43.160252 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152105 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 07:14:43.160252 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152110 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 07:14:43.160252 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152115 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 07:14:43.160252 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152119 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 07:14:43.160252 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152123 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 07:14:43.160252 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152135 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 07:14:43.160252 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152140 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 07:14:43.160252 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152144 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 07:14:43.160252 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152148 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 07:14:43.160252 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152152 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 07:14:43.160252 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152157 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 07:14:43.160252 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152161 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 07:14:43.160252 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152165 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 07:14:43.160692 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152169 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 07:14:43.160692 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152174 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 07:14:43.160692 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.152179 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 07:14:43.160692 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.152219 2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 07:14:43.160692 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153537 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 07:14:43.160692 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153577 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 07:14:43.160692 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153597 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 07:14:43.160692 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153603 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 07:14:43.160692 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153609 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 07:14:43.160692 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153614 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 07:14:43.160692 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153674 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 07:14:43.160692 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153835 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 07:14:43.160692 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153840 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 07:14:43.160692 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153843 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 07:14:43.160692 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153846 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 07:14:43.160692 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153852 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 07:14:43.161072 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153857 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 07:14:43.161072 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153861 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 07:14:43.161072 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153863 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 07:14:43.161072 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153866 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 07:14:43.161072 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153869 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 07:14:43.161072 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153872 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 07:14:43.161072 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153874 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 07:14:43.161072 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153877 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 07:14:43.161072 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153880 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 07:14:43.161072 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153883 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 07:14:43.161072 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153885 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 07:14:43.161072 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153888 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 07:14:43.161072 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153890 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 07:14:43.161072 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153893 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 07:14:43.161072 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153896 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 07:14:43.161072 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153898 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 07:14:43.161072 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153901 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 07:14:43.161072 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153903 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 07:14:43.161072 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153906 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 07:14:43.161072 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153909 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 07:14:43.161657 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153911 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 07:14:43.161657 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153914 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 07:14:43.161657 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153920 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 07:14:43.161657 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153923 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 07:14:43.161657 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153926 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 07:14:43.161657 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153929 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 07:14:43.161657 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153932 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 07:14:43.161657 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153935 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 07:14:43.161657 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153938 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 07:14:43.161657 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153941 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 07:14:43.161657 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153944 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 07:14:43.161657 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153947 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 07:14:43.161657 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153949 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 07:14:43.161657 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153952 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 07:14:43.161657 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153955 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 07:14:43.161657 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153957 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 07:14:43.161657 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153960 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 07:14:43.161657 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153963 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 07:14:43.161657 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153966 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 07:14:43.162162 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153968 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 07:14:43.162162 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153971 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 07:14:43.162162 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153974 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 07:14:43.162162 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153977 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 07:14:43.162162 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153979 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 07:14:43.162162 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153982 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 07:14:43.162162 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153984 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 07:14:43.162162 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153987 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 07:14:43.162162 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153989 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 07:14:43.162162 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153992 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 07:14:43.162162 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.153996 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 07:14:43.162162 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154001 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 07:14:43.162162 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154005 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 07:14:43.162162 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154008 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 07:14:43.162162 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154011 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 07:14:43.162162 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154014 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 07:14:43.162162 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154017 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 07:14:43.162162 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154019 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 07:14:43.162162 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154022 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 07:14:43.162645 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154025 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 07:14:43.162645 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154027 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 07:14:43.162645 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154030 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 07:14:43.162645 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154033 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 04 07:14:43.162645 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154035 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 07:14:43.162645 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154038 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 07:14:43.162645 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154040 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 07:14:43.162645 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154045 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 07:14:43.162645 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154048 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 07:14:43.162645 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154050 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 07:14:43.162645 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154053 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 07:14:43.162645 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154055 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 07:14:43.162645 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154058 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 07:14:43.162645 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154060 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 07:14:43.162645 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154063 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 07:14:43.162645 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154065 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 07:14:43.162645 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154068 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 07:14:43.162645 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154071 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 07:14:43.162645 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154073 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 07:14:43.162645 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154076 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 07:14:43.163268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154078 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 07:14:43.163268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154081 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 07:14:43.163268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154083 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 07:14:43.163268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154086 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 07:14:43.163268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154088 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 07:14:43.163268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154091 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 07:14:43.163268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154094 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 07:14:43.163268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154096 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 07:14:43.163268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154099 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 07:14:43.163268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154102 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 07:14:43.163268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154104 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 07:14:43.163268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154107 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 07:14:43.163268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154110 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 07:14:43.163268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154113 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 07:14:43.163268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154115 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 07:14:43.163268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154118 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 07:14:43.163741 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.154152 2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 07:14:43.163741 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154200 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 07:14:43.163741 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154205 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 07:14:43.163741 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154207 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 07:14:43.163741 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154210 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 07:14:43.163741 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154213 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 07:14:43.163741 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154215 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 07:14:43.163741 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154218 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 07:14:43.163741 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154220 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 07:14:43.163741 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154223 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 07:14:43.163741 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154226 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 07:14:43.163741 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154229 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 07:14:43.163741 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154231 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 07:14:43.163741 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154234 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 07:14:43.163741 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154236 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 07:14:43.163741 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154239 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 07:14:43.164326 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154242 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 07:14:43.164326 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154244 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 07:14:43.164326 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154247 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 07:14:43.164326 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154249 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 07:14:43.164326 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154254 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 07:14:43.164326 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154256 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 07:14:43.164326 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154259 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 07:14:43.164326 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154263 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 07:14:43.164326 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154267 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 07:14:43.164326 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154270 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 07:14:43.164326 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154272 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 07:14:43.164326 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154275 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 07:14:43.164326 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154278 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 07:14:43.164326 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154280 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 07:14:43.164326 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154283 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 07:14:43.164326 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154285 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 07:14:43.164326 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154288 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 07:14:43.164326 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154290 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 07:14:43.164326 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154293 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 07:14:43.164326 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154295 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 07:14:43.164836 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154298 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 07:14:43.164836 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154300 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 07:14:43.164836 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154303 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 07:14:43.164836 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154306 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 07:14:43.164836 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154308 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 07:14:43.164836 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154311 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 07:14:43.164836 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154313 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 07:14:43.164836 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154317 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 07:14:43.164836 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154319 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 07:14:43.164836 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154322 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 07:14:43.164836 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154325 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 07:14:43.164836 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154327 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 07:14:43.164836 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154330 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 07:14:43.164836 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154332 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 07:14:43.164836 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154335 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 07:14:43.164836 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154338 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 07:14:43.164836 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154342 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 07:14:43.164836 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154344 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 07:14:43.164836 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154347 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 07:14:43.165279 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154350 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 07:14:43.165279 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154352 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 07:14:43.165279 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154355 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 07:14:43.165279 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154357 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 07:14:43.165279 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154360 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 07:14:43.165279 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154363 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 07:14:43.165279 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154366 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 07:14:43.165279 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154369 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 07:14:43.165279 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154371 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 07:14:43.165279 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154374 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 07:14:43.165279 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154377 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 07:14:43.165279 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154379 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 07:14:43.165279 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154382 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 07:14:43.165279 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154384 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 07:14:43.165279 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154386 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 07:14:43.165279 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154389 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 07:14:43.165279 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154392 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 07:14:43.165279 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154394 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 07:14:43.165279 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154398 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 07:14:43.165775 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154401 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 07:14:43.165775 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154405 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 07:14:43.165775 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154408 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 07:14:43.165775 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154411 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 07:14:43.165775 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154414 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 07:14:43.165775 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154416 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 07:14:43.165775 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154419 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 07:14:43.165775 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154421 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 07:14:43.165775 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154424 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 07:14:43.165775 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154426 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 07:14:43.165775 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154430 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 07:14:43.165775 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154433 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 04 07:14:43.165775 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154435 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 07:14:43.165775 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154438 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 07:14:43.165775 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154440 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 07:14:43.165775 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154443 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 07:14:43.165775 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154445 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 07:14:43.165775 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154448 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 07:14:43.165775 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154450 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 07:14:43.165775 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154453 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 07:14:43.166298 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154455 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 07:14:43.166298 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154457 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 07:14:43.166298 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154460 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 07:14:43.166298 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154464 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 07:14:43.166298 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154466 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 07:14:43.166298 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154469 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 07:14:43.166298 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154471 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 07:14:43.166298 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154474 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 07:14:43.166298 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154476 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 07:14:43.166298 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154479 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 07:14:43.166298 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154481 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 07:14:43.166298 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154484 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 07:14:43.166298 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:43.154486 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 07:14:43.166298 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.154566 2576 server.go:957] "Client rotation is on, will bootstrap in background" Nov 04 07:14:43.166298 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.156521 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Nov 04 07:14:43.166298 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.157228 2576 server.go:1014] "Starting client certificate rotation" Nov 04 07:14:43.166298 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.157320 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 04 07:14:43.166298 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.157937 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 04 07:14:43.166762 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.158929 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 07:14:43.166762 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.159986 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 07:14:43.167511 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.167496 2576 log.go:25] "Validated CRI v1 runtime API" Nov 04 07:14:43.170256 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.170241 2576 log.go:25] "Validated CRI v1 image API" Nov 04 07:14:43.171075 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.171035 2576 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 04 07:14:43.174733 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.174708 2576 fs.go:135] Filesystem UUIDs: map[2738c287-4295-49b1-91c1-82f2317160b8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 fdcd6fe9-fe02-40d3-9d9e-e8c68cef7e9b:/dev/nvme0n1p3] Nov 04 07:14:43.174813 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.174731 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Nov 04 07:14:43.180927 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.180808 2576 manager.go:217] Machine: {Timestamp:2026-11-04 07:14:43.179628425 +0000 UTC m=+0.267669487 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099033 MemoryCapacity:33164324864 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29d654461ca6fd516277d32761a8af SystemUUID:ec29d654-461c-a6fd-5162-77d32761a8af BootID:e07bda21-e71b-4cf1-a45e-d4049adee76f Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582164480 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582160384 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:db:84:1a:ff Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:db:84:1a:ff Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:52:b7:9c:05:b6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164324864 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 04 07:14:43.181434 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.181421 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 04 07:14:43.181603 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.181540 2576 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 04 07:14:43.183781 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.183761 2576 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 04 07:14:43.183935 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.183783 2576 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-91.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 04 07:14:43.183982 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.183939 2576 topology_manager.go:143] "Creating topology manager with none policy" Nov 04 07:14:43.183982 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.183947 2576 container_manager_linux.go:311] "Creating device plugin manager" Nov 04 07:14:43.183982 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.183979 2576 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 07:14:43.184053 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.183996 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 07:14:43.184788 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.184778 2576 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 04 07:14:43.188472 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.188459 2576 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 04 07:14:43.188587 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.188580 2576 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 04 07:14:43.188624 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.188607 2576 kubelet.go:493] "Attempting to sync node with API server" Nov 04 07:14:43.188624 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.188622 2576 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 04 07:14:43.188672 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.188631 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 04 07:14:43.188672 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.188640 2576 kubelet.go:405] "Adding apiserver pod source" Nov 04 07:14:43.188672 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.188648 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 04 07:14:43.189038 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.189013 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 07:14:43.191060 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.191026 2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 04 07:14:43.192095 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.191756 2576 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 04 07:14:43.196828 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.196813 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 07:14:43.197558 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.197529 2576 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 04 07:14:43.197606 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.197590 2576 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 04 07:14:43.197762 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.197751 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 04 07:14:43.197794 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.197767 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 04 07:14:43.197794 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.197773 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 04 07:14:43.197794 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.197779 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 04 07:14:43.197794 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.197784 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 04 07:14:43.197794 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.197790 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 04 07:14:43.198450 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.198442 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 04 07:14:43.198477 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.198451 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 04 07:14:43.198477 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.198457 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 04 07:14:43.198477 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.198463 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 04 07:14:43.198477 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.198471 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 04 07:14:43.198657 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.198480 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 04 07:14:43.199000 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.198990 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 04 07:14:43.199027 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.199000 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 04 07:14:43.202767 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.202754 2576 server.go:1263] "Started kubelet" Nov 04 07:14:43.202876 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.202847 2576 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 04 07:14:43.202936 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.202852 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 04 07:14:43.202936 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.202917 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 04 07:14:43.203369 ip-10-0-130-91 systemd[1]: Started Kubernetes Kubelet. Nov 04 07:14:43.203871 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.203842 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-91.us-east-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Nov 04 07:14:43.204422 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.204399 2576 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 04 07:14:43.204568 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.204538 2576 server.go:317] "Adding debug handlers to kubelet server" Nov 04 07:14:43.210644 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:43.210625 2576 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Nov 04 07:14:43.212015 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.211997 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 04 07:14:43.212412 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.212389 2576 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 04 07:14:43.212520 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:43.212499 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-91.us-east-2.compute.internal\" not found" Nov 04 07:14:43.213100 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.213082 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 04 07:14:43.213100 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.213080 2576 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 04 07:14:43.213258 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.213109 2576 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 04 07:14:43.213258 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.213169 2576 factory.go:55] Registering systemd factory Nov 04 07:14:43.213258 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.213186 2576 factory.go:223] Registration of the systemd container factory successfully Nov 04 07:14:43.213258 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.213188 2576 reconstruct.go:97] "Volume reconstruction finished" Nov 04 07:14:43.213258 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.213200 2576 reconciler.go:29] "Reconciler: start to sync state" Nov 04 07:14:43.213439 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.213409 2576 factory.go:153] Registering CRI-O factory Nov 04 07:14:43.213439 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.213423 2576 factory.go:223] Registration of the crio container factory successfully Nov 04 07:14:43.213539 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.213486 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 04 07:14:43.213539 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.213510 2576 factory.go:103] Registering Raw factory Nov 04 07:14:43.213539 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.213525 2576 manager.go:1199] Started watching for new ooms in manager Nov 04 07:14:43.214457 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.214444 2576 manager.go:319] Starting recovery of all containers Nov 04 07:14:43.215227 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:43.215208 2576 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-91.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Nov 04 07:14:43.215296 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:43.215269 2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Nov 04 07:14:43.215456 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:43.215425 2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-91.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Nov 04 07:14:43.216033 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:43.214986 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-91.us-east-2.compute.internal.18e4c63527bf7a08 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-91.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-91.us-east-2.compute.internal,},FirstTimestamp:2026-11-04 07:14:43.202726408 +0000 UTC m=+0.290767470,LastTimestamp:2026-11-04 07:14:43.202726408 +0000 UTC m=+0.290767470,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-91.us-east-2.compute.internal,}" Nov 04 07:14:43.218898 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:43.218872 2576 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" Nov 04 07:14:43.226120 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.226101 2576 manager.go:324] Recovery completed Nov 04 07:14:43.229811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.229797 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 07:14:43.231426 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.231411 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 04 07:14:43.231479 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.231437 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 04 07:14:43.231479 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.231448 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 04 07:14:43.232646 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.232627 2576 cpu_manager.go:226] "Starting" policy="none" Nov 04 07:14:43.232646 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.232644 2576 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 04 07:14:43.232773 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.232648 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 07:14:43.232773 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.232661 2576 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 04 07:14:43.233392 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.233373 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 04 07:14:43.233452 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.233401 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 04 07:14:43.233452 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.233411 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 04 07:14:43.234039 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:43.233953 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-91.us-east-2.compute.internal.18e4c635297562cd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-91.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-91.us-east-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-91.us-east-2.compute.internal,},FirstTimestamp:2026-11-04 07:14:43.231425229 +0000 UTC m=+0.319466289,LastTimestamp:2026-11-04 07:14:43.231425229 +0000 UTC m=+0.319466289,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-91.us-east-2.compute.internal,}" Nov 04 07:14:43.234951 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.234937 2576 policy_none.go:50] "Start" Nov 04 07:14:43.234951 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.234953 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 04 07:14:43.235050 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.234970 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 04 07:14:43.237081 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.237069 2576 policy_none.go:44] "Start" Nov 04 07:14:43.248470 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:43.248375 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-91.us-east-2.compute.internal.18e4c6352975a308 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-91.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-91.us-east-2.compute.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-91.us-east-2.compute.internal,},FirstTimestamp:2026-11-04 07:14:43.231441672 +0000 UTC m=+0.319482732,LastTimestamp:2026-11-04 07:14:43.231441672 +0000 UTC m=+0.319482732,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-91.us-east-2.compute.internal,}" Nov 04 07:14:43.254672 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.254655 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-48g8h" Nov 04 07:14:43.254903 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:43.254846 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-91.us-east-2.compute.internal.18e4c6352975ca13 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-91.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-130-91.us-east-2.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-130-91.us-east-2.compute.internal,},FirstTimestamp:2026-11-04 07:14:43.231451667 +0000 UTC m=+0.319492727,LastTimestamp:2026-11-04 07:14:43.231451667 +0000 UTC m=+0.319492727,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-91.us-east-2.compute.internal,}" Nov 04 07:14:43.268170 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.268146 2576 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 04 07:14:43.268270 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.268252 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-48g8h" Nov 04 07:14:43.269450 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:43.269392 2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-130-91.us-east-2.compute.internal.18e4c635297562cd\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-91.us-east-2.compute.internal.18e4c635297562cd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-91.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-91.us-east-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-91.us-east-2.compute.internal,},FirstTimestamp:2026-11-04 07:14:43.231425229 +0000 UTC m=+0.319466289,LastTimestamp:2026-11-04 07:14:43.233388955 +0000 UTC m=+0.321430019,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-91.us-east-2.compute.internal,}" Nov 04 07:14:43.270670 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.270651 2576 manager.go:341] "Starting Device Plugin manager" Nov 04 07:14:43.270743 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:43.270689 2576 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 04 07:14:43.270743 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.270697 2576 server.go:87] "Starting device plugin registration server" Nov 04 07:14:43.270926 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.270909 2576 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 04 07:14:43.271024 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.270927 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 04 07:14:43.271098 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.271082 2576 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 04 07:14:43.271167 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.271155 2576 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 04 07:14:43.271167 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.271166 2576 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 04 07:14:43.271587 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:43.271568 2576 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 04 07:14:43.271662 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:43.271610 2576 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-91.us-east-2.compute.internal\" not found" Nov 04 07:14:43.386709 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.371719 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 07:14:43.386709 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.372784 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 04 07:14:43.386709 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.372813 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 04 07:14:43.386709 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.372827 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 04 07:14:43.386709 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.372857 2576 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:14:43.386709 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.382028 2576 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:14:43.386709 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:43.382049 2576 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-91.us-east-2.compute.internal\": node \"ip-10-0-130-91.us-east-2.compute.internal\" not found" Nov 04 07:14:43.417334 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.417302 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 04 07:14:43.418495 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.418481 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 04 07:14:43.418574 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.418507 2576 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 04 07:14:43.418574 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.418525 2576 kubelet.go:2521] "Starting kubelet main sync loop" Nov 04 07:14:43.418639 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:43.418573 2576 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Nov 04 07:14:43.420369 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:43.420350 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-91.us-east-2.compute.internal\" not found" Nov 04 07:14:43.428087 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.428071 2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 07:14:43.519475 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.519453 2576 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal"] Nov 04 07:14:43.519566 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.519513 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 07:14:43.520322 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.520308 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 04 07:14:43.520394 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.520337 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 04 07:14:43.520394 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.520351 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 04 07:14:43.520488 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:43.520417 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-91.us-east-2.compute.internal\" not found" Nov 04 07:14:43.522454 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.522440 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 07:14:43.522604 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.522589 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:14:43.522656 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.522620 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 07:14:43.523116 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.523101 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 04 07:14:43.523160 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.523116 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 04 07:14:43.523160 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.523130 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 04 07:14:43.523160 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.523139 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 04 07:14:43.523160 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.523153 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 04 07:14:43.523289 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.523141 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 04 07:14:43.525230 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.525215 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:14:43.525266 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.525251 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 07:14:43.525926 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.525911 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 04 07:14:43.525996 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.525936 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 04 07:14:43.525996 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.525956 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 04 07:14:43.550297 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:43.550278 2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-91.us-east-2.compute.internal\" not found" node="ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:14:43.553071 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:43.553056 2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-91.us-east-2.compute.internal\" not found" node="ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:14:43.616066 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.616045 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13dc07ab33ee08dade7a82db0cc41bf9-config\") pod \"kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal\" (UID: \"13dc07ab33ee08dade7a82db0cc41bf9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:14:43.616144 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.616068 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/62932641f82fcf60f802061dd0ecb4e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal\" (UID: \"62932641f82fcf60f802061dd0ecb4e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:14:43.616144 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.616083 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62932641f82fcf60f802061dd0ecb4e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal\" (UID: \"62932641f82fcf60f802061dd0ecb4e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:14:43.621172 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:43.621153 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-91.us-east-2.compute.internal\" not found" Nov 04 07:14:43.717164 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.717117 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62932641f82fcf60f802061dd0ecb4e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal\" (UID: \"62932641f82fcf60f802061dd0ecb4e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:14:43.717164 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.717140 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13dc07ab33ee08dade7a82db0cc41bf9-config\") pod \"kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal\" (UID: \"13dc07ab33ee08dade7a82db0cc41bf9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:14:43.717164 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.717157 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/62932641f82fcf60f802061dd0ecb4e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal\" (UID: \"62932641f82fcf60f802061dd0ecb4e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:14:43.717332 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.717181 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/62932641f82fcf60f802061dd0ecb4e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal\" (UID: \"62932641f82fcf60f802061dd0ecb4e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:14:43.717332 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.717224 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13dc07ab33ee08dade7a82db0cc41bf9-config\") pod \"kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal\" (UID: \"13dc07ab33ee08dade7a82db0cc41bf9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:14:43.717332 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.717222 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62932641f82fcf60f802061dd0ecb4e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal\" (UID: \"62932641f82fcf60f802061dd0ecb4e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:14:43.722248 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:43.722231 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-91.us-east-2.compute.internal\" not found" Nov 04 07:14:43.822749 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:43.822728 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-91.us-east-2.compute.internal\" not found" Nov 04 07:14:43.853919 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.853888 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:14:43.856041 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:43.856024 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:14:43.923805 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:43.923783 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-91.us-east-2.compute.internal\" not found" Nov 04 07:14:44.024362 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:44.024314 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-91.us-east-2.compute.internal\" not found" Nov 04 07:14:44.124783 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:44.124768 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-91.us-east-2.compute.internal\" not found" Nov 04 07:14:44.157065 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:44.157042 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Nov 04 07:14:44.157464 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:44.157157 2576 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 04 07:14:44.225206 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:44.225187 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-91.us-east-2.compute.internal\" not found" Nov 04 07:14:44.272853 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:44.272805 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 07:09:44 +0000 UTC" deadline="2028-04-30 00:30:11.067423419 +0000 UTC" Nov 04 07:14:44.272853 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:44.272849 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13025h15m26.794577048s" Nov 04 07:14:44.325435 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:44.325262 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-91.us-east-2.compute.internal\" not found" Nov 04 07:14:44.356413 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:44.356395 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 07:14:44.357516 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:44.357502 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 04 07:14:44.357600 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:44.357529 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 04 07:14:44.357600 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:44.357539 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 04 07:14:44.426493 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:44.426473 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-91.us-east-2.compute.internal\" not found" Nov 04 07:14:45.780868 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:45.780842 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62932641f82fcf60f802061dd0ecb4e4.slice/crio-14b30def96b8f2c9e04fae8c5c64c4de71b6a17186a15eca67789b82c7ea74f4 WatchSource:0}: Error finding container 14b30def96b8f2c9e04fae8c5c64c4de71b6a17186a15eca67789b82c7ea74f4: Status 404 returned error can't find the container with id 14b30def96b8f2c9e04fae8c5c64c4de71b6a17186a15eca67789b82c7ea74f4 Nov 04 07:14:45.790847 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:45.790831 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 07:14:45.797822 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:45.797801 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13dc07ab33ee08dade7a82db0cc41bf9.slice/crio-246bf3ef5c2f3f339c4d293e540ae9e30e0e82ef66477c7e99df996efba160c4 WatchSource:0}: Error finding container 246bf3ef5c2f3f339c4d293e540ae9e30e0e82ef66477c7e99df996efba160c4: Status 404 returned error can't find the container with id 246bf3ef5c2f3f339c4d293e540ae9e30e0e82ef66477c7e99df996efba160c4 Nov 04 07:14:45.842704 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:45.842682 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-91.us-east-2.compute.internal\" not found" Nov 04 07:14:45.943186 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:45.943143 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-91.us-east-2.compute.internal\" not found" Nov 04 07:14:45.966866 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:45.966850 2576 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 07:14:46.029185 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.029167 2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:14:46.048869 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.048851 2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 07:14:46.049789 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.049773 2576 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 07:14:46.050445 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.050432 2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:14:46.069845 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.069824 2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 07:14:46.073902 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.072656 2576 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 07:14:46.505599 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.505575 2576 apiserver.go:52] "Watching apiserver" Nov 04 07:14:46.514225 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.514199 2576 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 04 07:14:46.514592 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.514563 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-rq9pn","kube-system/konnectivity-agent-d9d49","openshift-image-registry/node-ca-p4d9h","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal","openshift-multus/multus-fschq","openshift-network-operator/iptables-alerter-v97f8","openshift-ovn-kubernetes/ovnkube-node-c4d9w","kube-system/global-pull-secret-syncer-dh9b9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz","openshift-cluster-node-tuning-operator/tuned-sqzqg","openshift-multus/network-metrics-daemon-xxcn8","kube-system/kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal","openshift-dns/node-resolver-4qdls","openshift-multus/multus-additional-cni-plugins-qpq6z"] Nov 04 07:14:46.517296 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.517275 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:14:46.519579 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.519532 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:14:46.523492 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.522300 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8bggl\"" Nov 04 07:14:46.523492 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.522340 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 04 07:14:46.523492 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.522393 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 04 07:14:46.523492 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.522426 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 04 07:14:46.523492 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.522526 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p4d9h" Nov 04 07:14:46.523492 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.523112 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 04 07:14:46.523492 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.523177 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 04 07:14:46.523492 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.523191 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 04 07:14:46.523492 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.523180 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 04 07:14:46.523492 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.523208 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 04 07:14:46.523492 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.523236 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-slv86\"" Nov 04 07:14:46.524108 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.524089 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:14:46.524212 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:46.524164 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rq9pn" podUID="0acaaee7-9bc3-499b-ba3f-50cc5d7498fd" Nov 04 07:14:46.525687 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.525667 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 04 07:14:46.525776 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.525765 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gcxz6\"" Nov 04 07:14:46.526117 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.525848 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 04 07:14:46.526117 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.525932 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 04 07:14:46.526250 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.526174 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fschq" Nov 04 07:14:46.528391 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.528369 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v97f8" Nov 04 07:14:46.528743 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.528726 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Nov 04 07:14:46.531030 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.531013 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.533862 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.533148 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.535752 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.535428 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:14:46.535752 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:46.535496 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dh9b9" podUID="aa159b4a-95ad-4a99-ae91-995c34fc44c1" Nov 04 07:14:46.538376 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.538348 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:14:46.538469 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:46.538407 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xxcn8" podUID="706127dc-f1c4-4724-aa56-ba5c5623bcf4" Nov 04 07:14:46.540073 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540049 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5dxh\" (UniqueName: \"kubernetes.io/projected/ee3c09af-7a35-49ff-a0cb-4bafc08875b1-kube-api-access-r5dxh\") pod \"node-ca-p4d9h\" (UID: \"ee3c09af-7a35-49ff-a0cb-4bafc08875b1\") " pod="openshift-image-registry/node-ca-p4d9h" Nov 04 07:14:46.540190 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540083 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-cnibin\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.540190 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540101 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-run-ovn\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.540190 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540124 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.540351 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:14:46.540351 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540217 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-registration-dir\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:14:46.540351 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540241 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-var-lib-cni-multus\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.540351 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540265 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmp9d\" (UniqueName: \"kubernetes.io/projected/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd-kube-api-access-lmp9d\") pod \"network-check-target-rq9pn\" (UID: \"0acaaee7-9bc3-499b-ba3f-50cc5d7498fd\") " pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:14:46.540351 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540285 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-sys-fs\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:14:46.540351 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540306 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-multus-cni-dir\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.540351 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540322 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-multus-conf-dir\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.540351 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540336 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-629vw\" (UniqueName: \"kubernetes.io/projected/ab2d1249-7775-4410-a8ef-8e03a4b362b9-kube-api-access-629vw\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.540713 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540367 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-node-log\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.540713 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540386 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-run-k8s-cni-cncf-io\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.540713 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540412 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-etc-kubernetes\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.540713 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540439 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqmtc\" (UniqueName: \"kubernetes.io/projected/dba52b0f-ebd1-410c-b0bf-f4acc5d295dd-kube-api-access-xqmtc\") pod \"iptables-alerter-v97f8\" (UID: \"dba52b0f-ebd1-410c-b0bf-f4acc5d295dd\") " pod="openshift-network-operator/iptables-alerter-v97f8" Nov 04 07:14:46.540713 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab2d1249-7775-4410-a8ef-8e03a4b362b9-multus-daemon-config\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.540713 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540483 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dba52b0f-ebd1-410c-b0bf-f4acc5d295dd-host-slash\") pod \"iptables-alerter-v97f8\" (UID: \"dba52b0f-ebd1-410c-b0bf-f4acc5d295dd\") " pod="openshift-network-operator/iptables-alerter-v97f8" Nov 04 07:14:46.540713 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540504 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-systemd-units\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.540713 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540527 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-run-systemd\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.540713 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540541 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-etc-openvswitch\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.540713 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540559 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-socket-dir\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:14:46.540713 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540572 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-run-netns\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.540713 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540591 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-run-openvswitch\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.540713 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540610 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9084f3dd-8da4-431c-8040-1e268c3fa964-ovn-node-metrics-cert\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.540713 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540628 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-device-dir\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:14:46.540713 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540644 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-cni-bin\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.540713 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540664 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9084f3dd-8da4-431c-8040-1e268c3fa964-env-overrides\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.541508 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540714 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-system-cni-dir\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:14:46.541508 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540747 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-run-ovn-kubernetes\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.541508 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540770 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9084f3dd-8da4-431c-8040-1e268c3fa964-ovnkube-script-lib\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.541508 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540794 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-slash\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.541508 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540828 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lngkw\" (UniqueName: \"kubernetes.io/projected/9084f3dd-8da4-431c-8040-1e268c3fa964-kube-api-access-lngkw\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.541508 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540927 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ndw7\" (UniqueName: \"kubernetes.io/projected/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-kube-api-access-7ndw7\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:14:46.541508 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.540988 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-cni-binary-copy\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:14:46.541508 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.541016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:14:46.541508 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.541053 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-etc-selinux\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:14:46.541508 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.541081 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-var-lib-cni-bin\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.541508 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.541105 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-kubelet\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.541508 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.541160 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-log-socket\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.541508 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.541209 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dba52b0f-ebd1-410c-b0bf-f4acc5d295dd-iptables-alerter-script\") pod \"iptables-alerter-v97f8\" (UID: \"dba52b0f-ebd1-410c-b0bf-f4acc5d295dd\") " pod="openshift-network-operator/iptables-alerter-v97f8" Nov 04 07:14:46.541508 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.541261 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:14:46.541508 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.541286 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-run-netns\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.541508 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.541309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-var-lib-openvswitch\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.542275 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.541332 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:14:46.542275 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.541355 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9084f3dd-8da4-431c-8040-1e268c3fa964-ovnkube-config\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.542275 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.541378 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee3c09af-7a35-49ff-a0cb-4bafc08875b1-host\") pod \"node-ca-p4d9h\" (UID: \"ee3c09af-7a35-49ff-a0cb-4bafc08875b1\") " pod="openshift-image-registry/node-ca-p4d9h" Nov 04 07:14:46.542275 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.541401 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab2d1249-7775-4410-a8ef-8e03a4b362b9-cni-binary-copy\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.542275 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.541457 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-hostroot\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.542275 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.541483 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-run-multus-certs\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.542275 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.541508 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-cnibin\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:14:46.542275 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.541532 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc8w7\" (UniqueName: \"kubernetes.io/projected/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-kube-api-access-tc8w7\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:14:46.542275 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.541568 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-cni-netd\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.542275 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.541628 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee3c09af-7a35-49ff-a0cb-4bafc08875b1-serviceca\") pod \"node-ca-p4d9h\" (UID: \"ee3c09af-7a35-49ff-a0cb-4bafc08875b1\") " pod="openshift-image-registry/node-ca-p4d9h" Nov 04 07:14:46.542275 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.541664 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4qdls" Nov 04 07:14:46.542275 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.541661 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-multus-socket-dir-parent\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.542275 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.541699 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-system-cni-dir\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.542275 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.541723 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-var-lib-kubelet\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.543662 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.543645 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d9d49" Nov 04 07:14:46.549315 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.549292 2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 04 07:14:46.565174 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.565152 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-z8xl2" Nov 04 07:14:46.577887 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.576865 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-z8xl2" Nov 04 07:14:46.621474 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.621438 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 04 07:14:46.621898 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.621737 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 04 07:14:46.621898 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.621756 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 04 07:14:46.621898 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.621737 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 04 07:14:46.621898 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.621805 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 04 07:14:46.621898 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.621809 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 04 07:14:46.621898 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.621858 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 04 07:14:46.621898 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.621881 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 04 07:14:46.621898 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.621884 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 04 07:14:46.622235 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.621886 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 04 07:14:46.623017 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.623001 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tqngx\"" Nov 04 07:14:46.623017 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.623013 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 04 07:14:46.623315 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.623296 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7qf26\"" Nov 04 07:14:46.623399 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.623342 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 04 07:14:46.623399 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.623372 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 04 07:14:46.623495 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.623465 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 04 07:14:46.623548 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.623510 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-8kctk\"" Nov 04 07:14:46.623597 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.623556 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 04 07:14:46.623651 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.623603 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-tjts4\"" Nov 04 07:14:46.624737 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.624720 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ltv7r\"" Nov 04 07:14:46.624737 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.624726 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 04 07:14:46.624866 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.624733 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l4l9x\"" Nov 04 07:14:46.630105 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.630079 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 04 07:14:46.642493 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.642467 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9084f3dd-8da4-431c-8040-1e268c3fa964-ovnkube-script-lib\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.642587 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.642509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99mdk\" (UniqueName: \"kubernetes.io/projected/473ae29e-1292-4044-988e-293d9ae8cfe3-kube-api-access-99mdk\") pod \"node-resolver-4qdls\" (UID: \"473ae29e-1292-4044-988e-293d9ae8cfe3\") " pod="openshift-dns/node-resolver-4qdls" Nov 04 07:14:46.642587 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.642538 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-lib-modules\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.642587 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.642564 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-slash\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.642730 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.642590 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lngkw\" (UniqueName: \"kubernetes.io/projected/9084f3dd-8da4-431c-8040-1e268c3fa964-kube-api-access-lngkw\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.642730 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.642614 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ndw7\" (UniqueName: \"kubernetes.io/projected/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-kube-api-access-7ndw7\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:14:46.642730 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.642640 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa159b4a-95ad-4a99-ae91-995c34fc44c1-original-pull-secret\") pod \"global-pull-secret-syncer-dh9b9\" (UID: \"aa159b4a-95ad-4a99-ae91-995c34fc44c1\") " pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:14:46.642730 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.642666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-cni-binary-copy\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:14:46.642730 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.642689 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:14:46.642730 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.642713 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-etc-selinux\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:14:46.643009 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.642737 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-var-lib-cni-bin\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.643009 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.642768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-systemd\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.643009 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.642791 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-kubelet\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.643009 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.642821 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-log-socket\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.643009 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.642853 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-host\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.643009 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.642877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dba52b0f-ebd1-410c-b0bf-f4acc5d295dd-iptables-alerter-script\") pod \"iptables-alerter-v97f8\" (UID: \"dba52b0f-ebd1-410c-b0bf-f4acc5d295dd\") " pod="openshift-network-operator/iptables-alerter-v97f8" Nov 04 07:14:46.643009 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.642901 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:14:46.643009 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.642926 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-run-netns\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.643009 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.642949 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-var-lib-openvswitch\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.643009 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.642972 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-var-lib-kubelet\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.643009 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.642994 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:14:46.643535 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643018 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9084f3dd-8da4-431c-8040-1e268c3fa964-ovnkube-config\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.643535 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643041 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee3c09af-7a35-49ff-a0cb-4bafc08875b1-host\") pod \"node-ca-p4d9h\" (UID: \"ee3c09af-7a35-49ff-a0cb-4bafc08875b1\") " pod="openshift-image-registry/node-ca-p4d9h" Nov 04 07:14:46.643535 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643071 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab2d1249-7775-4410-a8ef-8e03a4b362b9-cni-binary-copy\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.643535 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643096 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-hostroot\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.643535 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643122 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-run-multus-certs\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.643535 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643162 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-cnibin\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:14:46.643535 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643200 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc8w7\" (UniqueName: \"kubernetes.io/projected/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-kube-api-access-tc8w7\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:14:46.643535 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-cni-netd\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.643535 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643248 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee3c09af-7a35-49ff-a0cb-4bafc08875b1-serviceca\") pod \"node-ca-p4d9h\" (UID: \"ee3c09af-7a35-49ff-a0cb-4bafc08875b1\") " pod="openshift-image-registry/node-ca-p4d9h" Nov 04 07:14:46.643535 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643273 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-multus-socket-dir-parent\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.643535 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-modprobe-d\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.643535 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643334 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-system-cni-dir\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.643535 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643359 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-var-lib-kubelet\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.643535 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643380 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5dxh\" (UniqueName: \"kubernetes.io/projected/ee3c09af-7a35-49ff-a0cb-4bafc08875b1-kube-api-access-r5dxh\") pod \"node-ca-p4d9h\" (UID: \"ee3c09af-7a35-49ff-a0cb-4bafc08875b1\") " pod="openshift-image-registry/node-ca-p4d9h" Nov 04 07:14:46.643535 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-cnibin\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.643535 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643427 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b959b9f-cdaa-46cf-9775-593ee2ee7ed5-konnectivity-ca\") pod \"konnectivity-agent-d9d49\" (UID: \"9b959b9f-cdaa-46cf-9775-593ee2ee7ed5\") " pod="kube-system/konnectivity-agent-d9d49" Nov 04 07:14:46.643535 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643457 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/473ae29e-1292-4044-988e-293d9ae8cfe3-hosts-file\") pod \"node-resolver-4qdls\" (UID: \"473ae29e-1292-4044-988e-293d9ae8cfe3\") " pod="openshift-dns/node-resolver-4qdls" Nov 04 07:14:46.644327 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643480 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-kubernetes\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.644327 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-sysctl-d\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.644327 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643527 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-sys\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.644327 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643557 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-run-ovn\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.644327 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.644327 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643608 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:14:46.644327 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643638 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-registration-dir\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:14:46.644327 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643664 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-var-lib-cni-multus\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.644327 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643687 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-sysconfig\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.644327 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643712 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmp9d\" (UniqueName: \"kubernetes.io/projected/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd-kube-api-access-lmp9d\") pod \"network-check-target-rq9pn\" (UID: \"0acaaee7-9bc3-499b-ba3f-50cc5d7498fd\") " pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:14:46.644327 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643739 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-sys-fs\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:14:46.644327 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-multus-cni-dir\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.644327 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643788 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-multus-conf-dir\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.644327 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643812 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-629vw\" (UniqueName: \"kubernetes.io/projected/ab2d1249-7775-4410-a8ef-8e03a4b362b9-kube-api-access-629vw\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.644327 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643837 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs\") pod \"network-metrics-daemon-xxcn8\" (UID: \"706127dc-f1c4-4724-aa56-ba5c5623bcf4\") " pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:14:46.644327 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643870 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-tmp\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.644327 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643901 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-node-log\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.645103 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-run-k8s-cni-cncf-io\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.645103 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-etc-kubernetes\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.645103 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.643996 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/473ae29e-1292-4044-988e-293d9ae8cfe3-tmp-dir\") pod \"node-resolver-4qdls\" (UID: \"473ae29e-1292-4044-988e-293d9ae8cfe3\") " pod="openshift-dns/node-resolver-4qdls" Nov 04 07:14:46.645103 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.644020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-sysctl-conf\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.645103 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.644048 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-tuned\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.645103 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.644080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcpx4\" (UniqueName: \"kubernetes.io/projected/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-kube-api-access-zcpx4\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.645103 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.644108 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqmtc\" (UniqueName: \"kubernetes.io/projected/dba52b0f-ebd1-410c-b0bf-f4acc5d295dd-kube-api-access-xqmtc\") pod \"iptables-alerter-v97f8\" (UID: \"dba52b0f-ebd1-410c-b0bf-f4acc5d295dd\") " pod="openshift-network-operator/iptables-alerter-v97f8" Nov 04 07:14:46.645103 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.644150 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab2d1249-7775-4410-a8ef-8e03a4b362b9-multus-daemon-config\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.645103 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.644178 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-run\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.645103 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.644204 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dba52b0f-ebd1-410c-b0bf-f4acc5d295dd-host-slash\") pod \"iptables-alerter-v97f8\" (UID: \"dba52b0f-ebd1-410c-b0bf-f4acc5d295dd\") " pod="openshift-network-operator/iptables-alerter-v97f8" Nov 04 07:14:46.645103 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.644232 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-systemd-units\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.645103 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.644257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-run-systemd\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.645103 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.644282 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-etc-openvswitch\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.645103 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.644966 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9084f3dd-8da4-431c-8040-1e268c3fa964-ovnkube-script-lib\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.645103 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.645107 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-slash\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.645805 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.645677 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-socket-dir\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:14:46.645805 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.645722 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-run-netns\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.645805 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.645754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aa159b4a-95ad-4a99-ae91-995c34fc44c1-dbus\") pod \"global-pull-secret-syncer-dh9b9\" (UID: \"aa159b4a-95ad-4a99-ae91-995c34fc44c1\") " pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:14:46.645805 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.645782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-run-openvswitch\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.645993 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.645844 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9084f3dd-8da4-431c-8040-1e268c3fa964-ovn-node-metrics-cert\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.645993 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.645879 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-device-dir\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:14:46.645993 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.645910 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fctt9\" (UniqueName: \"kubernetes.io/projected/706127dc-f1c4-4724-aa56-ba5c5623bcf4-kube-api-access-fctt9\") pod \"network-metrics-daemon-xxcn8\" (UID: \"706127dc-f1c4-4724-aa56-ba5c5623bcf4\") " pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:14:46.645993 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.645939 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b959b9f-cdaa-46cf-9775-593ee2ee7ed5-agent-certs\") pod \"konnectivity-agent-d9d49\" (UID: \"9b959b9f-cdaa-46cf-9775-593ee2ee7ed5\") " pod="kube-system/konnectivity-agent-d9d49" Nov 04 07:14:46.645993 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.645966 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-cni-bin\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.646250 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.645992 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9084f3dd-8da4-431c-8040-1e268c3fa964-env-overrides\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.646250 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.646020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aa159b4a-95ad-4a99-ae91-995c34fc44c1-kubelet-config\") pod \"global-pull-secret-syncer-dh9b9\" (UID: \"aa159b4a-95ad-4a99-ae91-995c34fc44c1\") " pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:14:46.646250 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.646046 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-system-cni-dir\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:14:46.646250 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.646081 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-run-ovn-kubernetes\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.646250 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.646188 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-run-ovn-kubernetes\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.646250 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.646235 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-run-netns\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.646573 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.646299 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-run-openvswitch\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.646623 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.646605 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-cni-binary-copy\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:14:46.646679 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.646661 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-socket-dir\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:14:46.646739 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.646705 2576 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 04 07:14:46.647221 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.647128 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-cni-bin\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.647317 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.647220 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-device-dir\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:14:46.647575 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.647550 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-run-ovn\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.647624 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.647608 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.647658 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.647621 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9084f3dd-8da4-431c-8040-1e268c3fa964-env-overrides\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.647715 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.647660 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:14:46.647715 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.647696 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-system-cni-dir\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:14:46.647803 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.647709 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:14:46.647803 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.647713 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-registration-dir\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:14:46.647803 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.647766 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-var-lib-cni-multus\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.647938 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.647813 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-etc-selinux\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:14:46.647938 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.647835 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-run-k8s-cni-cncf-io\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.647938 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.647861 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-hostroot\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.647938 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.647875 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-run-multus-certs\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.647938 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.647880 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-etc-kubernetes\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.647938 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.647901 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-var-lib-cni-bin\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.647938 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.647916 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-cnibin\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:14:46.648231 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.648173 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-cni-netd\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.648342 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.648322 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dba52b0f-ebd1-410c-b0bf-f4acc5d295dd-iptables-alerter-script\") pod \"iptables-alerter-v97f8\" (UID: \"dba52b0f-ebd1-410c-b0bf-f4acc5d295dd\") " pod="openshift-network-operator/iptables-alerter-v97f8" Nov 04 07:14:46.648401 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.648343 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab2d1249-7775-4410-a8ef-8e03a4b362b9-cni-binary-copy\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.648401 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.648380 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-kubelet\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.648488 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.648415 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-log-socket\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.648596 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.648574 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-multus-cni-dir\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.648653 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.648598 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee3c09af-7a35-49ff-a0cb-4bafc08875b1-serviceca\") pod \"node-ca-p4d9h\" (UID: \"ee3c09af-7a35-49ff-a0cb-4bafc08875b1\") " pod="openshift-image-registry/node-ca-p4d9h" Nov 04 07:14:46.648653 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.648636 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-run-netns\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.648752 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.648660 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-multus-socket-dir-parent\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.648752 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.648662 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-var-lib-openvswitch\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.648752 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.648693 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-var-lib-kubelet\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.648752 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.648732 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-cnibin\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.648933 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.648774 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-system-cni-dir\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.648933 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.648862 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:14:46.648933 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.648864 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-sys-fs\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:14:46.648933 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.648906 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-multus-conf-dir\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.648933 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.648928 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee3c09af-7a35-49ff-a0cb-4bafc08875b1-host\") pod \"node-ca-p4d9h\" (UID: \"ee3c09af-7a35-49ff-a0cb-4bafc08875b1\") " pod="openshift-image-registry/node-ca-p4d9h" Nov 04 07:14:46.649186 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.648966 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dba52b0f-ebd1-410c-b0bf-f4acc5d295dd-host-slash\") pod \"iptables-alerter-v97f8\" (UID: \"dba52b0f-ebd1-410c-b0bf-f4acc5d295dd\") " pod="openshift-network-operator/iptables-alerter-v97f8" Nov 04 07:14:46.649186 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.649010 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-run-systemd\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.649186 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.649012 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-systemd-units\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.649334 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.649152 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-node-log\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.649334 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.649241 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9084f3dd-8da4-431c-8040-1e268c3fa964-ovnkube-config\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.649334 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.649268 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-etc-openvswitch\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.649334 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.649303 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:14:46.649499 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.649393 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab2d1249-7775-4410-a8ef-8e03a4b362b9-multus-daemon-config\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.652401 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.652380 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9084f3dd-8da4-431c-8040-1e268c3fa964-ovn-node-metrics-cert\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.657885 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:46.657864 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 07:14:46.657976 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:46.657889 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 07:14:46.657976 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:46.657903 2576 projected.go:196] Error preparing data for projected volume kube-api-access-lmp9d for pod openshift-network-diagnostics/network-check-target-rq9pn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 07:14:46.658076 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.658007 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ndw7\" (UniqueName: \"kubernetes.io/projected/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-kube-api-access-7ndw7\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:14:46.658076 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:46.658033 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd-kube-api-access-lmp9d podName:0acaaee7-9bc3-499b-ba3f-50cc5d7498fd nodeName:}" failed. No retries permitted until 2026-11-04 07:14:47.15799331 +0000 UTC m=+2.930447937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lmp9d" (UniqueName: "kubernetes.io/projected/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd-kube-api-access-lmp9d") pod "network-check-target-rq9pn" (UID: "0acaaee7-9bc3-499b-ba3f-50cc5d7498fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 07:14:46.658227 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.658206 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lngkw\" (UniqueName: \"kubernetes.io/projected/9084f3dd-8da4-431c-8040-1e268c3fa964-kube-api-access-lngkw\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.660560 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.660537 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc8w7\" (UniqueName: \"kubernetes.io/projected/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-kube-api-access-tc8w7\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:14:46.661240 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.661182 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqmtc\" (UniqueName: \"kubernetes.io/projected/dba52b0f-ebd1-410c-b0bf-f4acc5d295dd-kube-api-access-xqmtc\") pod \"iptables-alerter-v97f8\" (UID: \"dba52b0f-ebd1-410c-b0bf-f4acc5d295dd\") " pod="openshift-network-operator/iptables-alerter-v97f8" Nov 04 07:14:46.661240 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.661203 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-629vw\" (UniqueName: \"kubernetes.io/projected/ab2d1249-7775-4410-a8ef-8e03a4b362b9-kube-api-access-629vw\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:14:46.661823 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.661788 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5dxh\" (UniqueName: \"kubernetes.io/projected/ee3c09af-7a35-49ff-a0cb-4bafc08875b1-kube-api-access-r5dxh\") pod \"node-ca-p4d9h\" (UID: \"ee3c09af-7a35-49ff-a0cb-4bafc08875b1\") " pod="openshift-image-registry/node-ca-p4d9h" Nov 04 07:14:46.739558 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.739513 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal" event={"ID":"13dc07ab33ee08dade7a82db0cc41bf9","Type":"ContainerStarted","Data":"246bf3ef5c2f3f339c4d293e540ae9e30e0e82ef66477c7e99df996efba160c4"} Nov 04 07:14:46.740984 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.740956 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" event={"ID":"62932641f82fcf60f802061dd0ecb4e4","Type":"ContainerStarted","Data":"14b30def96b8f2c9e04fae8c5c64c4de71b6a17186a15eca67789b82c7ea74f4"} Nov 04 07:14:46.747301 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747282 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b959b9f-cdaa-46cf-9775-593ee2ee7ed5-konnectivity-ca\") pod \"konnectivity-agent-d9d49\" (UID: \"9b959b9f-cdaa-46cf-9775-593ee2ee7ed5\") " pod="kube-system/konnectivity-agent-d9d49" Nov 04 07:14:46.747416 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747309 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/473ae29e-1292-4044-988e-293d9ae8cfe3-hosts-file\") pod \"node-resolver-4qdls\" (UID: \"473ae29e-1292-4044-988e-293d9ae8cfe3\") " pod="openshift-dns/node-resolver-4qdls" Nov 04 07:14:46.747416 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747332 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-kubernetes\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.747416 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747350 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-sysctl-d\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.747416 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747370 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-sys\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.747416 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747394 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-sysconfig\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.747663 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747416 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/473ae29e-1292-4044-988e-293d9ae8cfe3-hosts-file\") pod \"node-resolver-4qdls\" (UID: \"473ae29e-1292-4044-988e-293d9ae8cfe3\") " pod="openshift-dns/node-resolver-4qdls" Nov 04 07:14:46.747663 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747433 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs\") pod \"network-metrics-daemon-xxcn8\" (UID: \"706127dc-f1c4-4724-aa56-ba5c5623bcf4\") " pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:14:46.747663 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747457 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-tmp\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.747663 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747480 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/473ae29e-1292-4044-988e-293d9ae8cfe3-tmp-dir\") pod \"node-resolver-4qdls\" (UID: \"473ae29e-1292-4044-988e-293d9ae8cfe3\") " pod="openshift-dns/node-resolver-4qdls" Nov 04 07:14:46.747663 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747502 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-sysctl-conf\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.747663 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747521 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-tuned\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.747663 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcpx4\" (UniqueName: \"kubernetes.io/projected/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-kube-api-access-zcpx4\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.747663 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747564 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-run\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.747663 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747590 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aa159b4a-95ad-4a99-ae91-995c34fc44c1-dbus\") pod \"global-pull-secret-syncer-dh9b9\" (UID: \"aa159b4a-95ad-4a99-ae91-995c34fc44c1\") " pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:14:46.747663 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747609 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fctt9\" (UniqueName: \"kubernetes.io/projected/706127dc-f1c4-4724-aa56-ba5c5623bcf4-kube-api-access-fctt9\") pod \"network-metrics-daemon-xxcn8\" (UID: \"706127dc-f1c4-4724-aa56-ba5c5623bcf4\") " pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:14:46.747663 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747623 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b959b9f-cdaa-46cf-9775-593ee2ee7ed5-agent-certs\") pod \"konnectivity-agent-d9d49\" (UID: \"9b959b9f-cdaa-46cf-9775-593ee2ee7ed5\") " pod="kube-system/konnectivity-agent-d9d49" Nov 04 07:14:46.747663 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747639 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aa159b4a-95ad-4a99-ae91-995c34fc44c1-kubelet-config\") pod \"global-pull-secret-syncer-dh9b9\" (UID: \"aa159b4a-95ad-4a99-ae91-995c34fc44c1\") " pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:14:46.747663 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747662 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99mdk\" (UniqueName: \"kubernetes.io/projected/473ae29e-1292-4044-988e-293d9ae8cfe3-kube-api-access-99mdk\") pod \"node-resolver-4qdls\" (UID: \"473ae29e-1292-4044-988e-293d9ae8cfe3\") " pod="openshift-dns/node-resolver-4qdls" Nov 04 07:14:46.748285 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747679 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-lib-modules\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.748285 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa159b4a-95ad-4a99-ae91-995c34fc44c1-original-pull-secret\") pod \"global-pull-secret-syncer-dh9b9\" (UID: \"aa159b4a-95ad-4a99-ae91-995c34fc44c1\") " pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:14:46.748285 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747726 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-systemd\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.748285 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747744 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-host\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.748285 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-var-lib-kubelet\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.748285 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747801 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-modprobe-d\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.748285 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747907 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-modprobe-d\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.748285 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747922 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b959b9f-cdaa-46cf-9775-593ee2ee7ed5-konnectivity-ca\") pod \"konnectivity-agent-d9d49\" (UID: \"9b959b9f-cdaa-46cf-9775-593ee2ee7ed5\") " pod="kube-system/konnectivity-agent-d9d49" Nov 04 07:14:46.748285 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747943 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-kubernetes\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.748285 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747982 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aa159b4a-95ad-4a99-ae91-995c34fc44c1-dbus\") pod \"global-pull-secret-syncer-dh9b9\" (UID: \"aa159b4a-95ad-4a99-ae91-995c34fc44c1\") " pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:14:46.748285 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.747986 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-run\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.748285 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.748087 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-sysctl-d\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.748285 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.748128 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-sys\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.748285 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.748191 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-sysconfig\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.748285 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.748193 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aa159b4a-95ad-4a99-ae91-995c34fc44c1-kubelet-config\") pod \"global-pull-secret-syncer-dh9b9\" (UID: \"aa159b4a-95ad-4a99-ae91-995c34fc44c1\") " pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:14:46.748285 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:46.748288 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 07:14:46.748982 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:46.748351 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs podName:706127dc-f1c4-4724-aa56-ba5c5623bcf4 nodeName:}" failed. No retries permitted until 2026-11-04 07:14:47.24833564 +0000 UTC m=+3.020790269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs") pod "network-metrics-daemon-xxcn8" (UID: "706127dc-f1c4-4724-aa56-ba5c5623bcf4") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 07:14:46.748982 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.748379 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-lib-modules\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.748982 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:46.748439 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 07:14:46.748982 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:46.748487 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa159b4a-95ad-4a99-ae91-995c34fc44c1-original-pull-secret podName:aa159b4a-95ad-4a99-ae91-995c34fc44c1 nodeName:}" failed. No retries permitted until 2026-11-04 07:14:47.248468394 +0000 UTC m=+3.020923020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa159b4a-95ad-4a99-ae91-995c34fc44c1-original-pull-secret") pod "global-pull-secret-syncer-dh9b9" (UID: "aa159b4a-95ad-4a99-ae91-995c34fc44c1") : object "kube-system"/"original-pull-secret" not registered Nov 04 07:14:46.748982 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.748517 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-systemd\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.748982 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.748544 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-host\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.748982 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.748569 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-var-lib-kubelet\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.748982 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.748897 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/473ae29e-1292-4044-988e-293d9ae8cfe3-tmp-dir\") pod \"node-resolver-4qdls\" (UID: \"473ae29e-1292-4044-988e-293d9ae8cfe3\") " pod="openshift-dns/node-resolver-4qdls" Nov 04 07:14:46.749399 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.749037 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-sysctl-conf\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.751154 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.750988 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-tmp\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.751154 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.751002 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b959b9f-cdaa-46cf-9775-593ee2ee7ed5-agent-certs\") pod \"konnectivity-agent-d9d49\" (UID: \"9b959b9f-cdaa-46cf-9775-593ee2ee7ed5\") " pod="kube-system/konnectivity-agent-d9d49" Nov 04 07:14:46.753568 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.753542 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-tuned\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.764662 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.764611 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcpx4\" (UniqueName: \"kubernetes.io/projected/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-kube-api-access-zcpx4\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.765174 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.765156 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fctt9\" (UniqueName: \"kubernetes.io/projected/706127dc-f1c4-4724-aa56-ba5c5623bcf4-kube-api-access-fctt9\") pod \"network-metrics-daemon-xxcn8\" (UID: \"706127dc-f1c4-4724-aa56-ba5c5623bcf4\") " pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:14:46.768749 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.768726 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99mdk\" (UniqueName: \"kubernetes.io/projected/473ae29e-1292-4044-988e-293d9ae8cfe3-kube-api-access-99mdk\") pod \"node-resolver-4qdls\" (UID: \"473ae29e-1292-4044-988e-293d9ae8cfe3\") " pod="openshift-dns/node-resolver-4qdls" Nov 04 07:14:46.799764 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.799746 2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 07:14:46.837110 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.837090 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:14:46.846562 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:46.846536 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c5588a_b014_4899_bef7_bbb6b6bfebd4.slice/crio-d4ba5ffc38814a045f18074839e02aa31322b01984b4032258d0ac5cfa550207 WatchSource:0}: Error finding container d4ba5ffc38814a045f18074839e02aa31322b01984b4032258d0ac5cfa550207: Status 404 returned error can't find the container with id d4ba5ffc38814a045f18074839e02aa31322b01984b4032258d0ac5cfa550207 Nov 04 07:14:46.856226 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.856202 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:14:46.863159 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.862995 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p4d9h" Nov 04 07:14:46.863159 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.863090 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fschq" Nov 04 07:14:46.866518 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:46.866496 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd31ffcc4_d558_4eec_94c0_3a6268fca6d3.slice/crio-a5509809c751c430910a2569e551a28462352a9b2371e33e4c459f96b3e34581 WatchSource:0}: Error finding container a5509809c751c430910a2569e551a28462352a9b2371e33e4c459f96b3e34581: Status 404 returned error can't find the container with id a5509809c751c430910a2569e551a28462352a9b2371e33e4c459f96b3e34581 Nov 04 07:14:46.869819 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.869388 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v97f8" Nov 04 07:14:46.873450 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:46.873428 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee3c09af_7a35_49ff_a0cb_4bafc08875b1.slice/crio-e55ea405bbc35313793d14c6c44c152c28f1ba7074335190bf2d9a470d61eaf1 WatchSource:0}: Error finding container e55ea405bbc35313793d14c6c44c152c28f1ba7074335190bf2d9a470d61eaf1: Status 404 returned error can't find the container with id e55ea405bbc35313793d14c6c44c152c28f1ba7074335190bf2d9a470d61eaf1 Nov 04 07:14:46.877784 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:46.877024 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab2d1249_7775_4410_a8ef_8e03a4b362b9.slice/crio-cd5fe46bcb2cb53656b520807a1233efd603cbe21e020c51ca947d78f923e8f0 WatchSource:0}: Error finding container cd5fe46bcb2cb53656b520807a1233efd603cbe21e020c51ca947d78f923e8f0: Status 404 returned error can't find the container with id cd5fe46bcb2cb53656b520807a1233efd603cbe21e020c51ca947d78f923e8f0 Nov 04 07:14:46.881304 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:46.881279 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddba52b0f_ebd1_410c_b0bf_f4acc5d295dd.slice/crio-e28118b37faf7b5bd1809f89939ca482ab5c3b491826233b3d8a06c6a6184aaa WatchSource:0}: Error finding container e28118b37faf7b5bd1809f89939ca482ab5c3b491826233b3d8a06c6a6184aaa: Status 404 returned error can't find the container with id e28118b37faf7b5bd1809f89939ca482ab5c3b491826233b3d8a06c6a6184aaa Nov 04 07:14:46.892307 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.892288 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:14:46.895867 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.895847 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:14:46.898465 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.898442 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4qdls" Nov 04 07:14:46.904278 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:46.904221 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd67d15cf_297b_4613_a63b_3c6dfa88bf8f.slice/crio-09a01943a3174f4a2ffbd07571aa1e76bc76d9f868cbb540f7955f4a544ac765 WatchSource:0}: Error finding container 09a01943a3174f4a2ffbd07571aa1e76bc76d9f868cbb540f7955f4a544ac765: Status 404 returned error can't find the container with id 09a01943a3174f4a2ffbd07571aa1e76bc76d9f868cbb540f7955f4a544ac765 Nov 04 07:14:46.904375 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:46.904305 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d9d49" Nov 04 07:14:46.907926 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:46.907902 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9084f3dd_8da4_431c_8040_1e268c3fa964.slice/crio-4d38d912b136fb5f5470b2fba0b5d1f03ae9205cf789f883f6a0a7ff9949f152 WatchSource:0}: Error finding container 4d38d912b136fb5f5470b2fba0b5d1f03ae9205cf789f883f6a0a7ff9949f152: Status 404 returned error can't find the container with id 4d38d912b136fb5f5470b2fba0b5d1f03ae9205cf789f883f6a0a7ff9949f152 Nov 04 07:14:46.911390 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:46.911351 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod473ae29e_1292_4044_988e_293d9ae8cfe3.slice/crio-5b3dcb0308f656de86c07a5633e2ddb97e0ce28f17a4651a283125a26e60776f WatchSource:0}: Error finding container 5b3dcb0308f656de86c07a5633e2ddb97e0ce28f17a4651a283125a26e60776f: Status 404 returned error can't find the container with id 5b3dcb0308f656de86c07a5633e2ddb97e0ce28f17a4651a283125a26e60776f Nov 04 07:14:46.915767 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:14:46.915741 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b959b9f_cdaa_46cf_9775_593ee2ee7ed5.slice/crio-0cf6228fefe2c5bbe65e4c7db998766701c7db5eec337dcd1ceca0a953eaec17 WatchSource:0}: Error finding container 0cf6228fefe2c5bbe65e4c7db998766701c7db5eec337dcd1ceca0a953eaec17: Status 404 returned error can't find the container with id 0cf6228fefe2c5bbe65e4c7db998766701c7db5eec337dcd1ceca0a953eaec17 Nov 04 07:14:47.250318 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:47.250297 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmp9d\" (UniqueName: \"kubernetes.io/projected/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd-kube-api-access-lmp9d\") pod \"network-check-target-rq9pn\" (UID: \"0acaaee7-9bc3-499b-ba3f-50cc5d7498fd\") " pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:14:47.250412 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:47.250335 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs\") pod \"network-metrics-daemon-xxcn8\" (UID: \"706127dc-f1c4-4724-aa56-ba5c5623bcf4\") " pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:14:47.250471 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:47.250415 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa159b4a-95ad-4a99-ae91-995c34fc44c1-original-pull-secret\") pod \"global-pull-secret-syncer-dh9b9\" (UID: \"aa159b4a-95ad-4a99-ae91-995c34fc44c1\") " pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:14:47.250471 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:47.250455 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 07:14:47.250572 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:47.250478 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 07:14:47.250572 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:47.250487 2576 projected.go:196] Error preparing data for projected volume kube-api-access-lmp9d for pod openshift-network-diagnostics/network-check-target-rq9pn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 07:14:47.250572 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:47.250517 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 07:14:47.250572 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:47.250532 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd-kube-api-access-lmp9d podName:0acaaee7-9bc3-499b-ba3f-50cc5d7498fd nodeName:}" failed. No retries permitted until 2026-11-04 07:14:48.250515455 +0000 UTC m=+4.022970089 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lmp9d" (UniqueName: "kubernetes.io/projected/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd-kube-api-access-lmp9d") pod "network-check-target-rq9pn" (UID: "0acaaee7-9bc3-499b-ba3f-50cc5d7498fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 07:14:47.250572 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:47.250568 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs podName:706127dc-f1c4-4724-aa56-ba5c5623bcf4 nodeName:}" failed. No retries permitted until 2026-11-04 07:14:48.250553663 +0000 UTC m=+4.023008276 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs") pod "network-metrics-daemon-xxcn8" (UID: "706127dc-f1c4-4724-aa56-ba5c5623bcf4") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 07:14:47.250736 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:47.250593 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 07:14:47.250736 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:47.250641 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa159b4a-95ad-4a99-ae91-995c34fc44c1-original-pull-secret podName:aa159b4a-95ad-4a99-ae91-995c34fc44c1 nodeName:}" failed. No retries permitted until 2026-11-04 07:14:48.250631116 +0000 UTC m=+4.023085730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa159b4a-95ad-4a99-ae91-995c34fc44c1-original-pull-secret") pod "global-pull-secret-syncer-dh9b9" (UID: "aa159b4a-95ad-4a99-ae91-995c34fc44c1") : object "kube-system"/"original-pull-secret" not registered Nov 04 07:14:47.581260 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:47.581095 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 07:09:46 +0000 UTC" deadline="2028-05-20 08:19:59.71303361 +0000 UTC" Nov 04 07:14:47.581260 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:47.581169 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13513h5m12.131869037s" Nov 04 07:14:47.734482 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:47.734457 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:14:47.734614 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:47.734573 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rq9pn" podUID="0acaaee7-9bc3-499b-ba3f-50cc5d7498fd" Nov 04 07:14:47.734735 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:47.734660 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:14:47.734798 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:47.734743 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xxcn8" podUID="706127dc-f1c4-4724-aa56-ba5c5623bcf4" Nov 04 07:14:47.758333 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:47.758165 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qpq6z" event={"ID":"d31ffcc4-d558-4eec-94c0-3a6268fca6d3","Type":"ContainerStarted","Data":"a5509809c751c430910a2569e551a28462352a9b2371e33e4c459f96b3e34581"} Nov 04 07:14:47.771678 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:47.771586 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d9d49" event={"ID":"9b959b9f-cdaa-46cf-9775-593ee2ee7ed5","Type":"ContainerStarted","Data":"0cf6228fefe2c5bbe65e4c7db998766701c7db5eec337dcd1ceca0a953eaec17"} Nov 04 07:14:47.773689 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:47.773584 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" event={"ID":"9084f3dd-8da4-431c-8040-1e268c3fa964","Type":"ContainerStarted","Data":"4d38d912b136fb5f5470b2fba0b5d1f03ae9205cf789f883f6a0a7ff9949f152"} Nov 04 07:14:47.775586 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:47.775526 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fschq" event={"ID":"ab2d1249-7775-4410-a8ef-8e03a4b362b9","Type":"ContainerStarted","Data":"cd5fe46bcb2cb53656b520807a1233efd603cbe21e020c51ca947d78f923e8f0"} Nov 04 07:14:47.776840 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:47.776758 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" event={"ID":"b8c5588a-b014-4899-bef7-bbb6b6bfebd4","Type":"ContainerStarted","Data":"d4ba5ffc38814a045f18074839e02aa31322b01984b4032258d0ac5cfa550207"} Nov 04 07:14:47.782687 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:47.782667 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4qdls" event={"ID":"473ae29e-1292-4044-988e-293d9ae8cfe3","Type":"ContainerStarted","Data":"5b3dcb0308f656de86c07a5633e2ddb97e0ce28f17a4651a283125a26e60776f"} Nov 04 07:14:47.786364 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:47.786304 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" event={"ID":"d67d15cf-297b-4613-a63b-3c6dfa88bf8f","Type":"ContainerStarted","Data":"09a01943a3174f4a2ffbd07571aa1e76bc76d9f868cbb540f7955f4a544ac765"} Nov 04 07:14:47.798400 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:47.797823 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v97f8" event={"ID":"dba52b0f-ebd1-410c-b0bf-f4acc5d295dd","Type":"ContainerStarted","Data":"e28118b37faf7b5bd1809f89939ca482ab5c3b491826233b3d8a06c6a6184aaa"} Nov 04 07:14:47.801499 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:47.801475 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p4d9h" event={"ID":"ee3c09af-7a35-49ff-a0cb-4bafc08875b1","Type":"ContainerStarted","Data":"e55ea405bbc35313793d14c6c44c152c28f1ba7074335190bf2d9a470d61eaf1"} Nov 04 07:14:48.260074 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:48.259220 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa159b4a-95ad-4a99-ae91-995c34fc44c1-original-pull-secret\") pod \"global-pull-secret-syncer-dh9b9\" (UID: \"aa159b4a-95ad-4a99-ae91-995c34fc44c1\") " pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:14:48.260074 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:48.259288 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmp9d\" (UniqueName: \"kubernetes.io/projected/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd-kube-api-access-lmp9d\") pod \"network-check-target-rq9pn\" (UID: \"0acaaee7-9bc3-499b-ba3f-50cc5d7498fd\") " pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:14:48.260074 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:48.259317 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs\") pod \"network-metrics-daemon-xxcn8\" (UID: \"706127dc-f1c4-4724-aa56-ba5c5623bcf4\") " pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:14:48.260074 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:48.259450 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 07:14:48.260074 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:48.259505 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs podName:706127dc-f1c4-4724-aa56-ba5c5623bcf4 nodeName:}" failed. No retries permitted until 2026-11-04 07:14:50.25948852 +0000 UTC m=+6.031943139 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs") pod "network-metrics-daemon-xxcn8" (UID: "706127dc-f1c4-4724-aa56-ba5c5623bcf4") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 07:14:48.260074 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:48.259871 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 07:14:48.260074 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:48.259917 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa159b4a-95ad-4a99-ae91-995c34fc44c1-original-pull-secret podName:aa159b4a-95ad-4a99-ae91-995c34fc44c1 nodeName:}" failed. No retries permitted until 2026-11-04 07:14:50.259903436 +0000 UTC m=+6.032358054 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa159b4a-95ad-4a99-ae91-995c34fc44c1-original-pull-secret") pod "global-pull-secret-syncer-dh9b9" (UID: "aa159b4a-95ad-4a99-ae91-995c34fc44c1") : object "kube-system"/"original-pull-secret" not registered Nov 04 07:14:48.260074 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:48.259990 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 07:14:48.260074 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:48.260006 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 07:14:48.260074 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:48.260018 2576 projected.go:196] Error preparing data for projected volume kube-api-access-lmp9d for pod openshift-network-diagnostics/network-check-target-rq9pn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 07:14:48.260074 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:48.260049 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd-kube-api-access-lmp9d podName:0acaaee7-9bc3-499b-ba3f-50cc5d7498fd nodeName:}" failed. No retries permitted until 2026-11-04 07:14:50.260039354 +0000 UTC m=+6.032493972 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lmp9d" (UniqueName: "kubernetes.io/projected/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd-kube-api-access-lmp9d") pod "network-check-target-rq9pn" (UID: "0acaaee7-9bc3-499b-ba3f-50cc5d7498fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 07:14:48.581526 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:48.581398 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 07:09:46 +0000 UTC" deadline="2028-06-15 14:22:41.558282654 +0000 UTC" Nov 04 07:14:48.581526 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:48.581462 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14143h7m52.976824836s" Nov 04 07:14:48.740883 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:48.737337 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:14:48.740883 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:48.737762 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dh9b9" podUID="aa159b4a-95ad-4a99-ae91-995c34fc44c1" Nov 04 07:14:48.818061 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:48.818004 2576 generic.go:356] "Generic (PLEG): container finished" podID="62932641f82fcf60f802061dd0ecb4e4" containerID="4c034ae6b059322ac45ee7c3000646801d95410ec6160a6ead049dc607a3f282" exitCode=0 Nov 04 07:14:48.818231 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:48.818111 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" event={"ID":"62932641f82fcf60f802061dd0ecb4e4","Type":"ContainerDied","Data":"4c034ae6b059322ac45ee7c3000646801d95410ec6160a6ead049dc607a3f282"} Nov 04 07:14:48.832317 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:48.832220 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal" event={"ID":"13dc07ab33ee08dade7a82db0cc41bf9","Type":"ContainerStarted","Data":"d8e823ab663e5a6fdf2ba94462666bc7f6833b376252ded6749d034f0126a924"} Nov 04 07:14:49.734811 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:49.734780 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:14:49.735235 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:49.734915 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xxcn8" podUID="706127dc-f1c4-4724-aa56-ba5c5623bcf4" Nov 04 07:14:49.735305 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:49.735290 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:14:49.735452 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:49.735352 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rq9pn" podUID="0acaaee7-9bc3-499b-ba3f-50cc5d7498fd" Nov 04 07:14:49.844546 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:49.844515 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" event={"ID":"62932641f82fcf60f802061dd0ecb4e4","Type":"ContainerStarted","Data":"ff05403554b29d0c701410b267e1d1c2d08e19d8cd61c806a879bf6521d81bac"} Nov 04 07:14:49.862590 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:49.862548 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal" podStartSLOduration=3.862533989 podStartE2EDuration="3.862533989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 07:14:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:14:48.858505114 +0000 UTC m=+4.630959750" watchObservedRunningTime="2026-11-04 07:14:49.862533989 +0000 UTC m=+5.634988630" Nov 04 07:14:50.280472 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:50.279469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmp9d\" (UniqueName: \"kubernetes.io/projected/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd-kube-api-access-lmp9d\") pod \"network-check-target-rq9pn\" (UID: \"0acaaee7-9bc3-499b-ba3f-50cc5d7498fd\") " pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:14:50.280472 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:50.279526 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs\") pod \"network-metrics-daemon-xxcn8\" (UID: \"706127dc-f1c4-4724-aa56-ba5c5623bcf4\") " pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:14:50.280472 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:50.279583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa159b4a-95ad-4a99-ae91-995c34fc44c1-original-pull-secret\") pod \"global-pull-secret-syncer-dh9b9\" (UID: \"aa159b4a-95ad-4a99-ae91-995c34fc44c1\") " pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:14:50.280472 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:50.279718 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 07:14:50.280472 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:50.279788 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa159b4a-95ad-4a99-ae91-995c34fc44c1-original-pull-secret podName:aa159b4a-95ad-4a99-ae91-995c34fc44c1 nodeName:}" failed. No retries permitted until 2026-11-04 07:14:54.279765241 +0000 UTC m=+10.052219875 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa159b4a-95ad-4a99-ae91-995c34fc44c1-original-pull-secret") pod "global-pull-secret-syncer-dh9b9" (UID: "aa159b4a-95ad-4a99-ae91-995c34fc44c1") : object "kube-system"/"original-pull-secret" not registered Nov 04 07:14:50.280472 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:50.280227 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 07:14:50.280472 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:50.280248 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 07:14:50.280472 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:50.280260 2576 projected.go:196] Error preparing data for projected volume kube-api-access-lmp9d for pod openshift-network-diagnostics/network-check-target-rq9pn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 07:14:50.280472 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:50.280306 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd-kube-api-access-lmp9d podName:0acaaee7-9bc3-499b-ba3f-50cc5d7498fd nodeName:}" failed. No retries permitted until 2026-11-04 07:14:54.280289913 +0000 UTC m=+10.052744540 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lmp9d" (UniqueName: "kubernetes.io/projected/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd-kube-api-access-lmp9d") pod "network-check-target-rq9pn" (UID: "0acaaee7-9bc3-499b-ba3f-50cc5d7498fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 07:14:50.280472 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:50.280365 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 07:14:50.280472 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:50.280398 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs podName:706127dc-f1c4-4724-aa56-ba5c5623bcf4 nodeName:}" failed. No retries permitted until 2026-11-04 07:14:54.280388416 +0000 UTC m=+10.052843043 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs") pod "network-metrics-daemon-xxcn8" (UID: "706127dc-f1c4-4724-aa56-ba5c5623bcf4") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 07:14:50.736845 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:50.736776 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:14:50.737321 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:50.736913 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dh9b9" podUID="aa159b4a-95ad-4a99-ae91-995c34fc44c1" Nov 04 07:14:50.855171 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:50.855121 2576 generic.go:356] "Generic (PLEG): container finished" podID="d31ffcc4-d558-4eec-94c0-3a6268fca6d3" containerID="489824c6c3844dba5df0a820841a2e0abc97164378b89a1143901f73a28cf267" exitCode=0 Nov 04 07:14:50.856194 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:50.856169 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qpq6z" event={"ID":"d31ffcc4-d558-4eec-94c0-3a6268fca6d3","Type":"ContainerDied","Data":"489824c6c3844dba5df0a820841a2e0abc97164378b89a1143901f73a28cf267"} Nov 04 07:14:50.884431 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:50.884382 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" podStartSLOduration=4.88436503 podStartE2EDuration="4.88436503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 07:14:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:14:49.862970345 +0000 UTC m=+5.635424980" watchObservedRunningTime="2026-11-04 07:14:50.88436503 +0000 UTC m=+6.656819665" Nov 04 07:14:51.736320 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:51.735803 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:14:51.736320 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:51.735933 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rq9pn" podUID="0acaaee7-9bc3-499b-ba3f-50cc5d7498fd" Nov 04 07:14:51.736541 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:51.736351 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:14:51.736541 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:51.736451 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xxcn8" podUID="706127dc-f1c4-4724-aa56-ba5c5623bcf4" Nov 04 07:14:51.877480 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:51.877431 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d9d49" event={"ID":"9b959b9f-cdaa-46cf-9775-593ee2ee7ed5","Type":"ContainerStarted","Data":"e8f01cb60aaa36feedea4ca53b4d0c29d69be08c54b537d7728c434535e66c80"} Nov 04 07:14:52.737275 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:52.736666 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:14:52.737275 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:52.736784 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dh9b9" podUID="aa159b4a-95ad-4a99-ae91-995c34fc44c1" Nov 04 07:14:52.882099 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:52.882014 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" event={"ID":"b8c5588a-b014-4899-bef7-bbb6b6bfebd4","Type":"ContainerStarted","Data":"bf4fa13c64ad7bca93311dedf204b5c071e51c05dfccfde038096843cd31476c"} Nov 04 07:14:52.885411 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:52.885255 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p4d9h" event={"ID":"ee3c09af-7a35-49ff-a0cb-4bafc08875b1","Type":"ContainerStarted","Data":"cf03b1ee3b11908c207cb4a7452e6951249ba34201fb4db56a8c1d6e308e9a84"} Nov 04 07:14:52.902682 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:52.902628 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d9d49" podStartSLOduration=3.768093896 podStartE2EDuration="7.902611191s" totalImagesPullingTime="4.134517295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:14:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:14:51.89953838 +0000 UTC m=+7.671993016" watchObservedRunningTime="2026-11-04 07:14:52.902611191 +0000 UTC m=+8.675065830" Nov 04 07:14:52.902807 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:52.902731 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-p4d9h" podStartSLOduration=3.811961942 podStartE2EDuration="8.902725015s" totalImagesPullingTime="5.090763073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 07:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:14:52.90228897 +0000 UTC m=+8.674743607" watchObservedRunningTime="2026-11-04 07:14:52.902725015 +0000 UTC m=+8.675179656" Nov 04 07:14:53.736200 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:53.734766 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:14:53.736200 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:53.734891 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rq9pn" podUID="0acaaee7-9bc3-499b-ba3f-50cc5d7498fd" Nov 04 07:14:53.736200 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:53.734958 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:14:53.736200 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:53.735032 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xxcn8" podUID="706127dc-f1c4-4724-aa56-ba5c5623bcf4" Nov 04 07:14:54.204065 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:54.203330 2576 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 04 07:14:54.314823 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:54.314745 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa159b4a-95ad-4a99-ae91-995c34fc44c1-original-pull-secret\") pod \"global-pull-secret-syncer-dh9b9\" (UID: \"aa159b4a-95ad-4a99-ae91-995c34fc44c1\") " pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:14:54.314823 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:54.314810 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmp9d\" (UniqueName: \"kubernetes.io/projected/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd-kube-api-access-lmp9d\") pod \"network-check-target-rq9pn\" (UID: \"0acaaee7-9bc3-499b-ba3f-50cc5d7498fd\") " pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:14:54.315027 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:54.314840 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs\") pod \"network-metrics-daemon-xxcn8\" (UID: \"706127dc-f1c4-4724-aa56-ba5c5623bcf4\") " pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:14:54.315027 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:54.314960 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 07:14:54.315027 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:54.315024 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs podName:706127dc-f1c4-4724-aa56-ba5c5623bcf4 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:02.315004234 +0000 UTC m=+18.087458865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs") pod "network-metrics-daemon-xxcn8" (UID: "706127dc-f1c4-4724-aa56-ba5c5623bcf4") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 07:14:54.315621 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:54.315426 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 07:14:54.315621 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:54.315473 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa159b4a-95ad-4a99-ae91-995c34fc44c1-original-pull-secret podName:aa159b4a-95ad-4a99-ae91-995c34fc44c1 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:02.315461618 +0000 UTC m=+18.087916231 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa159b4a-95ad-4a99-ae91-995c34fc44c1-original-pull-secret") pod "global-pull-secret-syncer-dh9b9" (UID: "aa159b4a-95ad-4a99-ae91-995c34fc44c1") : object "kube-system"/"original-pull-secret" not registered Nov 04 07:14:54.315621 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:54.315538 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 07:14:54.315621 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:54.315552 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 07:14:54.315621 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:54.315561 2576 projected.go:196] Error preparing data for projected volume kube-api-access-lmp9d for pod openshift-network-diagnostics/network-check-target-rq9pn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 07:14:54.315621 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:54.315584 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd-kube-api-access-lmp9d podName:0acaaee7-9bc3-499b-ba3f-50cc5d7498fd nodeName:}" failed. No retries permitted until 2026-11-04 07:15:02.315577331 +0000 UTC m=+18.088031943 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lmp9d" (UniqueName: "kubernetes.io/projected/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd-kube-api-access-lmp9d") pod "network-check-target-rq9pn" (UID: "0acaaee7-9bc3-499b-ba3f-50cc5d7498fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 07:14:54.593162 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:54.591226 2576 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T07:14:54.203345455Z","UUID":"58dc1507-4640-40c8-8214-178ea345514d","Handler":null,"Name":"","Endpoint":""} Nov 04 07:14:54.594382 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:54.593976 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 04 07:14:54.594382 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:54.594007 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 04 07:14:54.737911 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:54.737886 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:14:54.738004 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:54.737987 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dh9b9" podUID="aa159b4a-95ad-4a99-ae91-995c34fc44c1" Nov 04 07:14:54.891781 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:54.891045 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fschq" event={"ID":"ab2d1249-7775-4410-a8ef-8e03a4b362b9","Type":"ContainerStarted","Data":"4f8345c07e6277f5d4f4b394193910e7e2718ad3c542cd1abd5c0cb5cfe4d857"} Nov 04 07:14:54.894833 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:54.894768 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" event={"ID":"b8c5588a-b014-4899-bef7-bbb6b6bfebd4","Type":"ContainerStarted","Data":"c27b7a5fc5f3fe371b2c7cb250b6d173b48ba4a2ba0a45f5409df195fd909003"} Nov 04 07:14:54.896631 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:54.896607 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4qdls" event={"ID":"473ae29e-1292-4044-988e-293d9ae8cfe3","Type":"ContainerStarted","Data":"acba4da0be63568cdb809fa4fcd4a90627c7127e42318314ed9b64afaf7c274c"} Nov 04 07:14:54.933983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:54.933934 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-4qdls" podStartSLOduration=2.13318636 podStartE2EDuration="9.933919448s" totalImagesPullingTime="7.800733088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 07:14:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:14:54.933774305 +0000 UTC m=+10.706228940" watchObservedRunningTime="2026-11-04 07:14:54.933919448 +0000 UTC m=+10.706374084" Nov 04 07:14:54.934343 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:54.934303 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-fschq" podStartSLOduration=3.459732697 podStartE2EDuration="10.934297351s" totalImagesPullingTime="7.474564654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 07:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:14:54.91671771 +0000 UTC m=+10.689172428" watchObservedRunningTime="2026-11-04 07:14:54.934297351 +0000 UTC m=+10.706751989" Nov 04 07:14:55.735173 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:55.735148 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:14:55.735564 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:55.735242 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rq9pn" podUID="0acaaee7-9bc3-499b-ba3f-50cc5d7498fd" Nov 04 07:14:55.735564 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:55.735298 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:14:55.735564 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:55.735348 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xxcn8" podUID="706127dc-f1c4-4724-aa56-ba5c5623bcf4" Nov 04 07:14:55.902479 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:55.902394 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" event={"ID":"b8c5588a-b014-4899-bef7-bbb6b6bfebd4","Type":"ContainerStarted","Data":"357021a9327c5447d27b1a0dbdfd27766e976027deb7911fd966c61c23eb3b48"} Nov 04 07:14:55.904838 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:55.904809 2576 generic.go:356] "Generic (PLEG): container finished" podID="d31ffcc4-d558-4eec-94c0-3a6268fca6d3" containerID="f77d16cb1e9d51e9244304fc355f978e063a9a5e5bece29ccf8fd473fa89c9f9" exitCode=0 Nov 04 07:14:55.904977 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:55.904905 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qpq6z" event={"ID":"d31ffcc4-d558-4eec-94c0-3a6268fca6d3","Type":"ContainerDied","Data":"f77d16cb1e9d51e9244304fc355f978e063a9a5e5bece29ccf8fd473fa89c9f9"} Nov 04 07:14:55.928163 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:55.927424 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" podStartSLOduration=3.494745122 podStartE2EDuration="11.927406628s" totalImagesPullingTime="8.432661506s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 07:14:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:14:55.927232739 +0000 UTC m=+11.699687375" watchObservedRunningTime="2026-11-04 07:14:55.927406628 +0000 UTC m=+11.699861264" Nov 04 07:14:56.021790 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:56.021759 2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d9d49" Nov 04 07:14:56.022932 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:56.022759 2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d9d49" Nov 04 07:14:56.738584 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:56.738397 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:14:56.738945 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:56.738681 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dh9b9" podUID="aa159b4a-95ad-4a99-ae91-995c34fc44c1" Nov 04 07:14:56.908474 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:56.908432 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" event={"ID":"d67d15cf-297b-4613-a63b-3c6dfa88bf8f","Type":"ContainerStarted","Data":"676e27db6f83aba1462578d88ffa5ec20cb37133170e3c69d4104963156264ca"} Nov 04 07:14:56.910194 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:56.910167 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v97f8" event={"ID":"dba52b0f-ebd1-410c-b0bf-f4acc5d295dd","Type":"ContainerStarted","Data":"ba9551c5fdfe47c6d569767b7886edbfe6128e02625b43f4d3bba3d7596ed3db"} Nov 04 07:14:56.913041 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:56.913018 2576 generic.go:356] "Generic (PLEG): container finished" podID="d31ffcc4-d558-4eec-94c0-3a6268fca6d3" containerID="8f18914f811199317245bc13658ae48f6fbc4cdcf51aadba935bc6d30489047e" exitCode=0 Nov 04 07:14:56.913206 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:56.913185 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qpq6z" event={"ID":"d31ffcc4-d558-4eec-94c0-3a6268fca6d3","Type":"ContainerDied","Data":"8f18914f811199317245bc13658ae48f6fbc4cdcf51aadba935bc6d30489047e"} Nov 04 07:14:56.929506 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:56.929463 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" podStartSLOduration=2.04175819 podStartE2EDuration="11.92944879s" totalImagesPullingTime="9.8876906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 07:14:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:14:56.929433282 +0000 UTC m=+12.701887918" watchObservedRunningTime="2026-11-04 07:14:56.92944879 +0000 UTC m=+12.701903427" Nov 04 07:14:56.971279 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:56.971223 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-v97f8" podStartSLOduration=5.070841542 podStartE2EDuration="12.971209653s" totalImagesPullingTime="7.900368111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 07:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:14:56.970524838 +0000 UTC m=+12.742979474" watchObservedRunningTime="2026-11-04 07:14:56.971209653 +0000 UTC m=+12.743664290" Nov 04 07:14:57.735100 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:57.735073 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:14:57.735268 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:57.735197 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xxcn8" podUID="706127dc-f1c4-4724-aa56-ba5c5623bcf4" Nov 04 07:14:57.735268 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:57.735251 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:14:57.735372 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:57.735350 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rq9pn" podUID="0acaaee7-9bc3-499b-ba3f-50cc5d7498fd" Nov 04 07:14:58.735914 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:58.735247 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:14:58.735914 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:58.735371 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dh9b9" podUID="aa159b4a-95ad-4a99-ae91-995c34fc44c1" Nov 04 07:14:58.920491 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:58.920454 2576 generic.go:356] "Generic (PLEG): container finished" podID="d31ffcc4-d558-4eec-94c0-3a6268fca6d3" containerID="71edae701c6304644b8e3ea293008dc5bdc8e2942fafab0af950a867f9f580ba" exitCode=0 Nov 04 07:14:58.920644 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:58.920502 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qpq6z" event={"ID":"d31ffcc4-d558-4eec-94c0-3a6268fca6d3","Type":"ContainerDied","Data":"71edae701c6304644b8e3ea293008dc5bdc8e2942fafab0af950a867f9f580ba"} Nov 04 07:14:59.734573 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:59.734537 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:14:59.734573 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:14:59.734561 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:14:59.734803 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:59.734663 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rq9pn" podUID="0acaaee7-9bc3-499b-ba3f-50cc5d7498fd" Nov 04 07:14:59.735077 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:14:59.735053 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xxcn8" podUID="706127dc-f1c4-4724-aa56-ba5c5623bcf4" Nov 04 07:15:00.735387 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:00.735354 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:15:00.735803 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:00.735495 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dh9b9" podUID="aa159b4a-95ad-4a99-ae91-995c34fc44c1" Nov 04 07:15:00.930185 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:00.929989 2576 generic.go:356] "Generic (PLEG): container finished" podID="d31ffcc4-d558-4eec-94c0-3a6268fca6d3" containerID="69e7c24650c439eea61b14b339f392356972e43f4498423ca3c42a207dc471b0" exitCode=0 Nov 04 07:15:00.930185 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:00.930068 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qpq6z" event={"ID":"d31ffcc4-d558-4eec-94c0-3a6268fca6d3","Type":"ContainerDied","Data":"69e7c24650c439eea61b14b339f392356972e43f4498423ca3c42a207dc471b0"} Nov 04 07:15:01.734629 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:01.734609 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:15:01.734720 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:01.734641 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:15:01.734772 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:01.734753 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xxcn8" podUID="706127dc-f1c4-4724-aa56-ba5c5623bcf4" Nov 04 07:15:01.734889 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:01.734866 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rq9pn" podUID="0acaaee7-9bc3-499b-ba3f-50cc5d7498fd" Nov 04 07:15:01.935691 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:01.935658 2576 generic.go:356] "Generic (PLEG): container finished" podID="d31ffcc4-d558-4eec-94c0-3a6268fca6d3" containerID="5c163600b60d135c5adad7b3236f39f04fe0d59fd198cbe6eefe36020fbdbcaa" exitCode=0 Nov 04 07:15:01.936174 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:01.935722 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qpq6z" event={"ID":"d31ffcc4-d558-4eec-94c0-3a6268fca6d3","Type":"ContainerDied","Data":"5c163600b60d135c5adad7b3236f39f04fe0d59fd198cbe6eefe36020fbdbcaa"} Nov 04 07:15:01.938563 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:01.938546 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4d9w_9084f3dd-8da4-431c-8040-1e268c3fa964/ovn-acl-logging/0.log" Nov 04 07:15:01.938917 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:01.938892 2576 generic.go:356] "Generic (PLEG): container finished" podID="9084f3dd-8da4-431c-8040-1e268c3fa964" containerID="1e1567a8a7fb242737cd91e35a7beb64d9a55efb8030b18ce963c21d8079a719" exitCode=1 Nov 04 07:15:01.938994 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:01.938936 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" event={"ID":"9084f3dd-8da4-431c-8040-1e268c3fa964","Type":"ContainerStarted","Data":"60c6d96161968189f7482138f5c67321f5ed303af1dcaaa6ea5905005440e343"} Nov 04 07:15:01.939037 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:01.939005 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" event={"ID":"9084f3dd-8da4-431c-8040-1e268c3fa964","Type":"ContainerStarted","Data":"1575214e8cd819e3286a9f1da1a8dc8886d17e314c04788197e35d3c5b066055"} Nov 04 07:15:01.939079 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:01.939056 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" event={"ID":"9084f3dd-8da4-431c-8040-1e268c3fa964","Type":"ContainerStarted","Data":"632204dd40472c182865145dcb713e17e38baa4512dd046088584f62853c51b4"} Nov 04 07:15:01.939170 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:01.939105 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" event={"ID":"9084f3dd-8da4-431c-8040-1e268c3fa964","Type":"ContainerStarted","Data":"61fc7802188de0ad392dd9755ae36e7bbd57b16d5098e2b8d6bca0c572fd75d1"} Nov 04 07:15:01.939201 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:01.939170 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" event={"ID":"9084f3dd-8da4-431c-8040-1e268c3fa964","Type":"ContainerDied","Data":"1e1567a8a7fb242737cd91e35a7beb64d9a55efb8030b18ce963c21d8079a719"} Nov 04 07:15:01.939238 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:01.939219 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" event={"ID":"9084f3dd-8da4-431c-8040-1e268c3fa964","Type":"ContainerStarted","Data":"9f78ee635b25171449f8a6c0d307b4d4e35474f8e4829f425033fa9247336a39"} Nov 04 07:15:02.372297 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:02.372261 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmp9d\" (UniqueName: \"kubernetes.io/projected/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd-kube-api-access-lmp9d\") pod \"network-check-target-rq9pn\" (UID: \"0acaaee7-9bc3-499b-ba3f-50cc5d7498fd\") " pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:15:02.372462 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:02.372309 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs\") pod \"network-metrics-daemon-xxcn8\" (UID: \"706127dc-f1c4-4724-aa56-ba5c5623bcf4\") " pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:15:02.372462 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:02.372348 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa159b4a-95ad-4a99-ae91-995c34fc44c1-original-pull-secret\") pod \"global-pull-secret-syncer-dh9b9\" (UID: \"aa159b4a-95ad-4a99-ae91-995c34fc44c1\") " pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:15:02.372462 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:02.372430 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 07:15:02.372462 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:02.372451 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 07:15:02.372462 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:02.372462 2576 projected.go:196] Error preparing data for projected volume kube-api-access-lmp9d for pod openshift-network-diagnostics/network-check-target-rq9pn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 07:15:02.372708 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:02.372465 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 07:15:02.372708 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:02.372475 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 07:15:02.372708 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:02.372515 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd-kube-api-access-lmp9d podName:0acaaee7-9bc3-499b-ba3f-50cc5d7498fd nodeName:}" failed. No retries permitted until 2026-11-04 07:15:18.372502042 +0000 UTC m=+34.144956656 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lmp9d" (UniqueName: "kubernetes.io/projected/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd-kube-api-access-lmp9d") pod "network-check-target-rq9pn" (UID: "0acaaee7-9bc3-499b-ba3f-50cc5d7498fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 07:15:02.372708 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:02.372531 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs podName:706127dc-f1c4-4724-aa56-ba5c5623bcf4 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:18.372524529 +0000 UTC m=+34.144979142 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs") pod "network-metrics-daemon-xxcn8" (UID: "706127dc-f1c4-4724-aa56-ba5c5623bcf4") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 07:15:02.372708 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:02.372541 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa159b4a-95ad-4a99-ae91-995c34fc44c1-original-pull-secret podName:aa159b4a-95ad-4a99-ae91-995c34fc44c1 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:18.372535833 +0000 UTC m=+34.144990446 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa159b4a-95ad-4a99-ae91-995c34fc44c1-original-pull-secret") pod "global-pull-secret-syncer-dh9b9" (UID: "aa159b4a-95ad-4a99-ae91-995c34fc44c1") : object "kube-system"/"original-pull-secret" not registered Nov 04 07:15:02.735547 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:02.735330 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:15:02.735685 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:02.735595 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dh9b9" podUID="aa159b4a-95ad-4a99-ae91-995c34fc44c1" Nov 04 07:15:02.943550 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:02.943518 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qpq6z" event={"ID":"d31ffcc4-d558-4eec-94c0-3a6268fca6d3","Type":"ContainerStarted","Data":"1b630b00ef3f0b45ee2843afc6d87ee1fc1c025cf762f4da080a2cab7994db76"} Nov 04 07:15:02.970757 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:02.970721 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qpq6z" podStartSLOduration=8.555136098 podStartE2EDuration="18.970709361s" totalImagesPullingTime="10.415573263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 07:14:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:15:02.970219444 +0000 UTC m=+18.742674079" watchObservedRunningTime="2026-11-04 07:15:02.970709361 +0000 UTC m=+18.743163995" Nov 04 07:15:03.734927 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:03.734893 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:15:03.734927 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:03.734920 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:15:03.735125 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:03.735002 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xxcn8" podUID="706127dc-f1c4-4724-aa56-ba5c5623bcf4" Nov 04 07:15:03.735177 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:03.735118 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rq9pn" podUID="0acaaee7-9bc3-499b-ba3f-50cc5d7498fd" Nov 04 07:15:04.735609 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:04.735576 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:15:04.735984 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:04.735660 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dh9b9" podUID="aa159b4a-95ad-4a99-ae91-995c34fc44c1" Nov 04 07:15:04.949882 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:04.949856 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4d9w_9084f3dd-8da4-431c-8040-1e268c3fa964/ovn-acl-logging/0.log" Nov 04 07:15:04.950238 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:04.950215 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" event={"ID":"9084f3dd-8da4-431c-8040-1e268c3fa964","Type":"ContainerStarted","Data":"a0b8e8a3b2f37b9b356c2c0bf1c43f5e776b6a8150f620147fbd744c7b31b7cb"} Nov 04 07:15:05.735031 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:05.734999 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:15:05.735203 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:05.734998 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:15:05.735203 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:05.735113 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xxcn8" podUID="706127dc-f1c4-4724-aa56-ba5c5623bcf4" Nov 04 07:15:05.735203 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:05.735196 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rq9pn" podUID="0acaaee7-9bc3-499b-ba3f-50cc5d7498fd" Nov 04 07:15:06.734800 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:06.734764 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:15:06.735637 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:06.734891 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dh9b9" podUID="aa159b4a-95ad-4a99-ae91-995c34fc44c1" Nov 04 07:15:06.956892 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:06.956872 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4d9w_9084f3dd-8da4-431c-8040-1e268c3fa964/ovn-acl-logging/0.log" Nov 04 07:15:06.957237 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:06.957216 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" event={"ID":"9084f3dd-8da4-431c-8040-1e268c3fa964","Type":"ContainerStarted","Data":"a5be41432e15eaa53a19385a71f5e5b8d8806cb8f316bc89a5e627396b7222c5"} Nov 04 07:15:06.957488 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:06.957470 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:06.957571 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:06.957554 2576 scope.go:122] "RemoveContainer" containerID="1e1567a8a7fb242737cd91e35a7beb64d9a55efb8030b18ce963c21d8079a719" Nov 04 07:15:06.973407 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:06.973386 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:07.735009 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:07.734975 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:15:07.735443 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:07.735151 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:15:07.735443 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:07.735143 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rq9pn" podUID="0acaaee7-9bc3-499b-ba3f-50cc5d7498fd" Nov 04 07:15:07.735443 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:07.735221 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xxcn8" podUID="706127dc-f1c4-4724-aa56-ba5c5623bcf4" Nov 04 07:15:07.833895 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:07.833864 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rq9pn"] Nov 04 07:15:07.836672 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:07.836648 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dh9b9"] Nov 04 07:15:07.836791 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:07.836749 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:15:07.836876 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:07.836852 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dh9b9" podUID="aa159b4a-95ad-4a99-ae91-995c34fc44c1" Nov 04 07:15:07.840184 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:07.840162 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xxcn8"] Nov 04 07:15:07.962247 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:07.962228 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4d9w_9084f3dd-8da4-431c-8040-1e268c3fa964/ovn-acl-logging/0.log" Nov 04 07:15:07.962592 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:07.962571 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" event={"ID":"9084f3dd-8da4-431c-8040-1e268c3fa964","Type":"ContainerStarted","Data":"8642970f8d7fbe37c475e0d985ec42bc9c6ac887c28debcbc33a7ee30b13a085"} Nov 04 07:15:07.962660 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:07.962602 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:15:07.962660 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:07.962611 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:15:07.962660 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:07.962652 2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 07:15:07.962762 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:07.962686 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xxcn8" podUID="706127dc-f1c4-4724-aa56-ba5c5623bcf4" Nov 04 07:15:07.962803 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:07.962792 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:07.962900 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:07.962874 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rq9pn" podUID="0acaaee7-9bc3-499b-ba3f-50cc5d7498fd" Nov 04 07:15:07.977255 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:07.977235 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:07.998639 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:07.998579 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" podStartSLOduration=9.373704286 podStartE2EDuration="23.998569049s" totalImagesPullingTime="14.624864763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 07:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:15:07.99700823 +0000 UTC m=+23.769462883" watchObservedRunningTime="2026-11-04 07:15:07.998569049 +0000 UTC m=+23.771023684" Nov 04 07:15:08.964453 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:08.964426 2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 07:15:09.676796 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:09.676769 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:09.735105 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:09.735079 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:15:09.735229 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:09.735195 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:15:09.735229 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:09.735205 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rq9pn" podUID="0acaaee7-9bc3-499b-ba3f-50cc5d7498fd" Nov 04 07:15:09.735297 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:09.735279 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dh9b9" podUID="aa159b4a-95ad-4a99-ae91-995c34fc44c1" Nov 04 07:15:09.735297 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:09.735282 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:15:09.735363 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:09.735352 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xxcn8" podUID="706127dc-f1c4-4724-aa56-ba5c5623bcf4" Nov 04 07:15:10.459944 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:10.459880 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d9d49" Nov 04 07:15:10.460314 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:10.460027 2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 07:15:10.460477 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:10.460463 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d9d49" Nov 04 07:15:11.735247 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:11.735217 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:15:11.735643 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:11.735305 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:15:11.735643 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:11.735310 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xxcn8" podUID="706127dc-f1c4-4724-aa56-ba5c5623bcf4" Nov 04 07:15:11.735643 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:11.735318 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:15:11.735643 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:11.735380 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rq9pn" podUID="0acaaee7-9bc3-499b-ba3f-50cc5d7498fd" Nov 04 07:15:11.735643 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:11.735437 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dh9b9" podUID="aa159b4a-95ad-4a99-ae91-995c34fc44c1" Nov 04 07:15:13.734741 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:13.734611 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:15:13.734741 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:13.734645 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:15:13.734741 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:13.734716 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:15:13.735073 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:13.734739 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rq9pn" podUID="0acaaee7-9bc3-499b-ba3f-50cc5d7498fd" Nov 04 07:15:13.735073 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:13.734806 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xxcn8" podUID="706127dc-f1c4-4724-aa56-ba5c5623bcf4" Nov 04 07:15:13.735073 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:13.734879 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dh9b9" podUID="aa159b4a-95ad-4a99-ae91-995c34fc44c1" Nov 04 07:15:14.031097 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.031025 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeReady" Nov 04 07:15:14.031267 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.031165 2576 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Nov 04 07:15:14.071656 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.071628 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-kfsw5"] Nov 04 07:15:14.075936 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.075914 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-smsdz"] Nov 04 07:15:14.076044 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.076029 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-kfsw5" Nov 04 07:15:14.081440 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.081416 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-smsdz" Nov 04 07:15:14.084081 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.084059 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-wzwrl"] Nov 04 07:15:14.088263 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.088242 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" Nov 04 07:15:14.088380 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.088320 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" Nov 04 07:15:14.088761 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.088745 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6d87c68c59-n7zhf"] Nov 04 07:15:14.088936 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.088800 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-wzwrl" Nov 04 07:15:14.092120 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.092100 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85f5799855-6xlbc"] Nov 04 07:15:14.092412 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.092393 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:14.096053 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.095363 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng"] Nov 04 07:15:14.096053 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.095486 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.098036 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.098018 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-p5lnr"] Nov 04 07:15:14.098256 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.098239 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng" Nov 04 07:15:14.101838 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.101815 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Nov 04 07:15:14.101929 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.101848 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Nov 04 07:15:14.102071 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.102048 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Nov 04 07:15:14.102208 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.102146 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Nov 04 07:15:14.102301 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.102227 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-z4qw5\"" Nov 04 07:15:14.102301 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.102227 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p5dks\"" Nov 04 07:15:14.102301 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.102297 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Nov 04 07:15:14.102508 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.102491 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Nov 04 07:15:14.102642 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.102628 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8"] Nov 04 07:15:14.102874 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.102725 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:14.104169 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.104152 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Nov 04 07:15:14.104283 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.104202 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-twxpm\"" Nov 04 07:15:14.105904 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.105890 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-q8mhz"] Nov 04 07:15:14.105999 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.105987 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" Nov 04 07:15:14.109196 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.109029 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw"] Nov 04 07:15:14.109196 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.109110 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-q8mhz" Nov 04 07:15:14.112166 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.112127 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp"] Nov 04 07:15:14.113215 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.113199 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw" Nov 04 07:15:14.115350 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.115331 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67f4948c94-mmrkw"] Nov 04 07:15:14.116447 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.116323 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp" Nov 04 07:15:14.120636 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.120619 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-vlsf6"] Nov 04 07:15:14.120838 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.120728 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.124301 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.124273 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-9k9rx"] Nov 04 07:15:14.131384 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.131357 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-vlsf6" Nov 04 07:15:14.139117 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.139096 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-9slp7"] Nov 04 07:15:14.139237 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.139217 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:14.142851 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.142831 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-kfsw5"] Nov 04 07:15:14.142948 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.142872 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-smsdz"] Nov 04 07:15:14.142948 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.142900 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6x2rp"] Nov 04 07:15:14.143058 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.142947 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-9slp7" Nov 04 07:15:14.145901 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.145878 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-wzwrl"] Nov 04 07:15:14.145985 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.145937 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rtcv5"] Nov 04 07:15:14.145985 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.145956 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:14.151643 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.151627 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-q8mhz"] Nov 04 07:15:14.151713 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.151653 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng"] Nov 04 07:15:14.151713 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.151667 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-p5lnr"] Nov 04 07:15:14.151713 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.151679 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp"] Nov 04 07:15:14.151713 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.151691 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-9slp7"] Nov 04 07:15:14.151713 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.151703 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8"] Nov 04 07:15:14.151872 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.151717 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-9k9rx"] Nov 04 07:15:14.151872 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.151730 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d87c68c59-n7zhf"] Nov 04 07:15:14.151872 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.151744 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6x2rp"] Nov 04 07:15:14.151872 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.151747 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rtcv5" Nov 04 07:15:14.151872 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.151760 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85f5799855-6xlbc"] Nov 04 07:15:14.151872 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.151776 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-vlsf6"] Nov 04 07:15:14.151872 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.151788 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw"] Nov 04 07:15:14.151872 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.151800 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rtcv5"] Nov 04 07:15:14.151872 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.151812 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67f4948c94-mmrkw"] Nov 04 07:15:14.163371 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.163347 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4fml\" (UniqueName: \"kubernetes.io/projected/5240a510-6179-45d9-bb60-b3fc3054e304-kube-api-access-q4fml\") pod \"kas-connection-checker-685895c7c9-kfsw5\" (UID: \"5240a510-6179-45d9-bb60-b3fc3054e304\") " pod="kube-system/kas-connection-checker-685895c7c9-kfsw5" Nov 04 07:15:14.163459 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.163386 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-default-certificate\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:14.163459 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.163411 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t66qf\" (UniqueName: \"kubernetes.io/projected/c96c91ba-0da0-4c2c-a881-e3ffffe63714-kube-api-access-t66qf\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:14.163537 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.163518 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-tls\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.163570 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.163545 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v2qr\" (UniqueName: \"kubernetes.io/projected/f12932cd-facc-4cf2-bd45-d359ae6d6012-kube-api-access-5v2qr\") pod \"cluster-monitoring-operator-884576c57-hb4ng\" (UID: \"f12932cd-facc-4cf2-bd45-d359ae6d6012\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng" Nov 04 07:15:14.163610 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.163574 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-stats-auth\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:14.163665 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.163616 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-metrics-certs\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:14.163707 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.163661 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-installation-pull-secrets\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.163743 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.163708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f12932cd-facc-4cf2-bd45-d359ae6d6012-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-hb4ng\" (UID: \"f12932cd-facc-4cf2-bd45-d359ae6d6012\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng" Nov 04 07:15:14.163782 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.163748 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwmcz\" (UniqueName: \"kubernetes.io/projected/712361a9-8da4-4367-b3e9-a60bdc909482-kube-api-access-gwmcz\") pod \"kas-connection-checker-685895c7c9-wzwrl\" (UID: \"712361a9-8da4-4367-b3e9-a60bdc909482\") " pod="kube-system/kas-connection-checker-685895c7c9-wzwrl" Nov 04 07:15:14.163782 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.163765 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-trusted-ca\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.163872 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.163816 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-bound-sa-token\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.163958 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.163936 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:14.164002 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.163979 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-image-registry-private-configuration\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.164045 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.164004 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-ca-trust-extracted\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.164045 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.164027 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f12932cd-facc-4cf2-bd45-d359ae6d6012-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-hb4ng\" (UID: \"f12932cd-facc-4cf2-bd45-d359ae6d6012\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng" Nov 04 07:15:14.164122 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.164105 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzb6d\" (UniqueName: \"kubernetes.io/projected/6307c016-6fa4-4890-a9e5-0a0ad2f4a484-kube-api-access-wzb6d\") pod \"kas-connection-checker-685895c7c9-smsdz\" (UID: \"6307c016-6fa4-4890-a9e5-0a0ad2f4a484\") " pod="kube-system/kas-connection-checker-685895c7c9-smsdz" Nov 04 07:15:14.164204 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.164179 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-certificates\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.164258 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.164225 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mknjr\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-kube-api-access-mknjr\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.186852 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.186831 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 04 07:15:14.186852 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.186836 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Nov 04 07:15:14.186991 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.186912 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 04 07:15:14.186991 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.186933 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Nov 04 07:15:14.186991 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.186943 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 04 07:15:14.186991 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.186956 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Nov 04 07:15:14.187108 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.186985 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Nov 04 07:15:14.187313 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.187298 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 04 07:15:14.187415 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.187387 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Nov 04 07:15:14.187415 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.187306 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 04 07:15:14.187415 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.187324 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Nov 04 07:15:14.187565 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.187369 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 04 07:15:14.187565 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.187318 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Nov 04 07:15:14.187668 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.187651 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Nov 04 07:15:14.187774 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.187758 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Nov 04 07:15:14.187863 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.187817 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 04 07:15:14.188012 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.187994 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Nov 04 07:15:14.188113 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.188099 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" Nov 04 07:15:14.188938 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.188913 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 04 07:15:14.188938 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.188925 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Nov 04 07:15:14.189063 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.188953 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Nov 04 07:15:14.189063 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.188970 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Nov 04 07:15:14.189063 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.188960 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 04 07:15:14.189225 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.189182 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Nov 04 07:15:14.189225 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.189186 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Nov 04 07:15:14.189225 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.189185 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Nov 04 07:15:14.189225 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.189215 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Nov 04 07:15:14.190459 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.190443 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Nov 04 07:15:14.199427 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.199408 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Nov 04 07:15:14.209095 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.209076 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Nov 04 07:15:14.209095 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.209093 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Nov 04 07:15:14.210284 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.210263 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Nov 04 07:15:14.210363 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.210297 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Nov 04 07:15:14.210363 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.210337 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Nov 04 07:15:14.210485 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.210470 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Nov 04 07:15:14.211204 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.210664 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 04 07:15:14.211204 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.210672 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-7rfcz\"" Nov 04 07:15:14.211204 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.210487 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 04 07:15:14.211204 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.210518 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Nov 04 07:15:14.211204 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.210526 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-x7zz4\"" Nov 04 07:15:14.211473 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.211217 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-d7v7x\"" Nov 04 07:15:14.213156 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.211592 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-mbbzm\"" Nov 04 07:15:14.213156 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.211643 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Nov 04 07:15:14.213156 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.211697 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-h4sd8\"" Nov 04 07:15:14.213156 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.211730 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rfngn\"" Nov 04 07:15:14.213156 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.211823 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fnvfk\"" Nov 04 07:15:14.213156 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.212439 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-mkgln\"" Nov 04 07:15:14.213156 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.212493 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Nov 04 07:15:14.213156 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.212503 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-z986p\"" Nov 04 07:15:14.213156 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.212617 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6pjn4\"" Nov 04 07:15:14.265337 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.265311 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f12932cd-facc-4cf2-bd45-d359ae6d6012-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-hb4ng\" (UID: \"f12932cd-facc-4cf2-bd45-d359ae6d6012\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng" Nov 04 07:15:14.265419 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.265344 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6652cbf0-521e-411b-9f75-2ce1f7c6a05b-cert\") pod \"ingress-canary-rtcv5\" (UID: \"6652cbf0-521e-411b-9f75-2ce1f7c6a05b\") " pod="openshift-ingress-canary/ingress-canary-rtcv5" Nov 04 07:15:14.265419 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.265369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-certificates\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.265419 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.265395 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsp74\" (UniqueName: \"kubernetes.io/projected/8deda5b1-d839-4a8b-b902-8e341ffe5340-kube-api-access-zsp74\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:14.265592 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.265448 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:14.265592 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.265463 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 07:15:14.265592 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.265479 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-bound-sa-token\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.265592 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.265511 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f12932cd-facc-4cf2-bd45-d359ae6d6012-cluster-monitoring-operator-tls podName:f12932cd-facc-4cf2-bd45-d359ae6d6012 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:14.765496519 +0000 UTC m=+30.537951132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f12932cd-facc-4cf2-bd45-d359ae6d6012-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-hb4ng" (UID: "f12932cd-facc-4cf2-bd45-d359ae6d6012") : secret "cluster-monitoring-operator-tls" not found Nov 04 07:15:14.265592 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.265561 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ecfd331a-08c4-43ac-a58c-9f43935d06ed-config\") pod \"console-operator-7cd56b8dbc-9k9rx\" (UID: \"ecfd331a-08c4-43ac-a58c-9f43935d06ed\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:14.265799 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.265594 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v2qr\" (UniqueName: \"kubernetes.io/projected/f12932cd-facc-4cf2-bd45-d359ae6d6012-kube-api-access-5v2qr\") pod \"cluster-monitoring-operator-884576c57-hb4ng\" (UID: \"f12932cd-facc-4cf2-bd45-d359ae6d6012\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng" Nov 04 07:15:14.265799 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.265639 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfrm9\" (UniqueName: \"kubernetes.io/projected/07b0128a-5ba7-40f9-9f0c-fbfeae05b64e-kube-api-access-bfrm9\") pod \"volume-data-source-validator-58c9f5f46d-q8mhz\" (UID: \"07b0128a-5ba7-40f9-9f0c-fbfeae05b64e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-q8mhz" Nov 04 07:15:14.265799 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.265697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d8m5\" (UniqueName: \"kubernetes.io/projected/9f9af642-8ada-4711-b1d1-e6b086e6b16c-kube-api-access-4d8m5\") pod \"service-ca-operator-544d749c8c-qvdsw\" (UID: \"9f9af642-8ada-4711-b1d1-e6b086e6b16c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw" Nov 04 07:15:14.265799 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.265721 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqzcl\" (UniqueName: \"kubernetes.io/projected/ecfd331a-08c4-43ac-a58c-9f43935d06ed-kube-api-access-vqzcl\") pod \"console-operator-7cd56b8dbc-9k9rx\" (UID: \"ecfd331a-08c4-43ac-a58c-9f43935d06ed\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:14.265799 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.265763 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f9af642-8ada-4711-b1d1-e6b086e6b16c-serving-cert\") pod \"service-ca-operator-544d749c8c-qvdsw\" (UID: \"9f9af642-8ada-4711-b1d1-e6b086e6b16c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw" Nov 04 07:15:14.266040 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.265817 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-stats-auth\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:14.266040 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.265845 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-metrics-certs\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:14.266040 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.265872 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-image-registry-private-configuration\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.266040 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.265898 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcs6z\" (UniqueName: \"kubernetes.io/projected/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-kube-api-access-pcs6z\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:14.266040 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.265925 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-nginx-conf\") pod \"networking-console-plugin-86c478bb88-vlsf6\" (UID: \"4e036a5c-ee3f-4b8f-a173-b3b6c052bca7\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-vlsf6" Nov 04 07:15:14.266040 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.265934 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 07:15:14.266040 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.265950 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-vlsf6\" (UID: \"4e036a5c-ee3f-4b8f-a173-b3b6c052bca7\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-vlsf6" Nov 04 07:15:14.266040 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.265971 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-metrics-certs podName:c96c91ba-0da0-4c2c-a881-e3ffffe63714 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:14.765957236 +0000 UTC m=+30.538411852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-metrics-certs") pod "router-default-6d87c68c59-n7zhf" (UID: "c96c91ba-0da0-4c2c-a881-e3ffffe63714") : secret "router-metrics-certs-default" not found Nov 04 07:15:14.266040 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.265976 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-certificates\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.266040 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.266004 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jrqx8\" (UID: \"3ea0ef4d-2fdb-4090-965f-3db3237a4c69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" Nov 04 07:15:14.266040 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.266027 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp\" (UID: \"9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp" Nov 04 07:15:14.266516 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.266095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp\" (UID: \"9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp" Nov 04 07:15:14.266516 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.266191 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-installation-pull-secrets\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.266516 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.266223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-bound-sa-token\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.266516 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.266249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-serving-cert\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:14.266516 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.266280 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-certificates\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.266516 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.266301 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tjsb\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-kube-api-access-9tjsb\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.266516 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.266382 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-image-registry-private-configuration\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.266516 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.266410 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-tls\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.266516 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.266479 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vjds\" (UniqueName: \"kubernetes.io/projected/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-kube-api-access-9vjds\") pod \"cluster-samples-operator-6ddb6c8b94-jrqx8\" (UID: \"3ea0ef4d-2fdb-4090-965f-3db3237a4c69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" Nov 04 07:15:14.266884 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.266522 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzb6d\" (UniqueName: \"kubernetes.io/projected/6307c016-6fa4-4890-a9e5-0a0ad2f4a484-kube-api-access-wzb6d\") pod \"kas-connection-checker-685895c7c9-smsdz\" (UID: \"6307c016-6fa4-4890-a9e5-0a0ad2f4a484\") " pod="kube-system/kas-connection-checker-685895c7c9-smsdz" Nov 04 07:15:14.266884 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.266546 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mknjr\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-kube-api-access-mknjr\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.266884 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.266581 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-ca-trust-extracted\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.266884 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.266667 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-trusted-ca\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.266884 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.266702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4fml\" (UniqueName: \"kubernetes.io/projected/5240a510-6179-45d9-bb60-b3fc3054e304-kube-api-access-q4fml\") pod \"kas-connection-checker-685895c7c9-kfsw5\" (UID: \"5240a510-6179-45d9-bb60-b3fc3054e304\") " pod="kube-system/kas-connection-checker-685895c7c9-kfsw5" Nov 04 07:15:14.266884 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.266727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-default-certificate\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:14.266884 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.266753 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-service-ca-bundle\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:14.266884 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.266776 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ecfd331a-08c4-43ac-a58c-9f43935d06ed-serving-cert\") pod \"console-operator-7cd56b8dbc-9k9rx\" (UID: \"ecfd331a-08c4-43ac-a58c-9f43935d06ed\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:14.266884 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.266799 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w6vl\" (UniqueName: \"kubernetes.io/projected/9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb-kube-api-access-6w6vl\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp\" (UID: \"9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp" Nov 04 07:15:14.266884 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.266839 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-tls\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.267287 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.266914 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-jrqx8\" (UID: \"3ea0ef4d-2fdb-4090-965f-3db3237a4c69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" Nov 04 07:15:14.267287 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.266978 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 07:15:14.267287 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.266991 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f5799855-6xlbc: secret "image-registry-tls" not found Nov 04 07:15:14.267287 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.267040 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-tls podName:fb5b977d-e13b-4499-8f7d-57b96f1b62bb nodeName:}" failed. No retries permitted until 2026-11-04 07:15:14.767026571 +0000 UTC m=+30.539481197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-tls") pod "image-registry-85f5799855-6xlbc" (UID: "fb5b977d-e13b-4499-8f7d-57b96f1b62bb") : secret "image-registry-tls" not found Nov 04 07:15:14.267287 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.267068 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f9af642-8ada-4711-b1d1-e6b086e6b16c-config\") pod \"service-ca-operator-544d749c8c-qvdsw\" (UID: \"9f9af642-8ada-4711-b1d1-e6b086e6b16c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw" Nov 04 07:15:14.267287 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.267093 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8v8x\" (UniqueName: \"kubernetes.io/projected/6652cbf0-521e-411b-9f75-2ce1f7c6a05b-kube-api-access-j8v8x\") pod \"ingress-canary-rtcv5\" (UID: \"6652cbf0-521e-411b-9f75-2ce1f7c6a05b\") " pod="openshift-ingress-canary/ingress-canary-rtcv5" Nov 04 07:15:14.267287 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.267124 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-installation-pull-secrets\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.267287 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.267224 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-tmp\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:14.267287 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.267260 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f12932cd-facc-4cf2-bd45-d359ae6d6012-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-hb4ng\" (UID: \"f12932cd-facc-4cf2-bd45-d359ae6d6012\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng" Nov 04 07:15:14.267683 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.267297 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8deda5b1-d839-4a8b-b902-8e341ffe5340-config-volume\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:14.267683 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.267408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8deda5b1-d839-4a8b-b902-8e341ffe5340-metrics-tls\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:14.267683 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.267434 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8deda5b1-d839-4a8b-b902-8e341ffe5340-tmp-dir\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:14.267683 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.267506 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ecfd331a-08c4-43ac-a58c-9f43935d06ed-trusted-ca\") pod \"console-operator-7cd56b8dbc-9k9rx\" (UID: \"ecfd331a-08c4-43ac-a58c-9f43935d06ed\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:14.267683 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.267569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:14.267683 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.267597 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t66qf\" (UniqueName: \"kubernetes.io/projected/c96c91ba-0da0-4c2c-a881-e3ffffe63714-kube-api-access-t66qf\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:14.267683 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.267629 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwmcz\" (UniqueName: \"kubernetes.io/projected/712361a9-8da4-4367-b3e9-a60bdc909482-kube-api-access-gwmcz\") pod \"kas-connection-checker-685895c7c9-wzwrl\" (UID: \"712361a9-8da4-4367-b3e9-a60bdc909482\") " pod="kube-system/kas-connection-checker-685895c7c9-wzwrl" Nov 04 07:15:14.267683 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.267656 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-986mn\" (UniqueName: \"kubernetes.io/projected/dfb5c54b-81e0-4f3a-92de-ea544696ee4b-kube-api-access-986mn\") pod \"network-check-source-6f78d59f99-9slp7\" (UID: \"dfb5c54b-81e0-4f3a-92de-ea544696ee4b\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-9slp7" Nov 04 07:15:14.268053 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.267754 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle podName:c96c91ba-0da0-4c2c-a881-e3ffffe63714 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:14.76774045 +0000 UTC m=+30.540195080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle") pod "router-default-6d87c68c59-n7zhf" (UID: "c96c91ba-0da0-4c2c-a881-e3ffffe63714") : configmap references non-existent config key: service-ca.crt Nov 04 07:15:14.268053 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.267849 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-trusted-ca\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.268053 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.267884 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-ca-trust-extracted\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.268053 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.267913 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-snapshots\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:14.268291 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.268266 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-ca-trust-extracted\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.268660 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.268636 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-trusted-ca\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.268825 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.268802 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f12932cd-facc-4cf2-bd45-d359ae6d6012-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-hb4ng\" (UID: \"f12932cd-facc-4cf2-bd45-d359ae6d6012\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng" Nov 04 07:15:14.269923 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.269902 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-installation-pull-secrets\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.270001 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.269919 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-image-registry-private-configuration\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.270001 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.269938 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-stats-auth\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:14.270001 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.269925 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-default-certificate\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:14.293103 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.293058 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-bound-sa-token\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.293103 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.293076 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mknjr\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-kube-api-access-mknjr\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.293517 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.293496 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4fml\" (UniqueName: \"kubernetes.io/projected/5240a510-6179-45d9-bb60-b3fc3054e304-kube-api-access-q4fml\") pod \"kas-connection-checker-685895c7c9-kfsw5\" (UID: \"5240a510-6179-45d9-bb60-b3fc3054e304\") " pod="kube-system/kas-connection-checker-685895c7c9-kfsw5" Nov 04 07:15:14.300597 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.300576 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v2qr\" (UniqueName: \"kubernetes.io/projected/f12932cd-facc-4cf2-bd45-d359ae6d6012-kube-api-access-5v2qr\") pod \"cluster-monitoring-operator-884576c57-hb4ng\" (UID: \"f12932cd-facc-4cf2-bd45-d359ae6d6012\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng" Nov 04 07:15:14.300697 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.300681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzb6d\" (UniqueName: \"kubernetes.io/projected/6307c016-6fa4-4890-a9e5-0a0ad2f4a484-kube-api-access-wzb6d\") pod \"kas-connection-checker-685895c7c9-smsdz\" (UID: \"6307c016-6fa4-4890-a9e5-0a0ad2f4a484\") " pod="kube-system/kas-connection-checker-685895c7c9-smsdz" Nov 04 07:15:14.300769 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.300750 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwmcz\" (UniqueName: \"kubernetes.io/projected/712361a9-8da4-4367-b3e9-a60bdc909482-kube-api-access-gwmcz\") pod \"kas-connection-checker-685895c7c9-wzwrl\" (UID: \"712361a9-8da4-4367-b3e9-a60bdc909482\") " pod="kube-system/kas-connection-checker-685895c7c9-wzwrl" Nov 04 07:15:14.303374 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.303352 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t66qf\" (UniqueName: \"kubernetes.io/projected/c96c91ba-0da0-4c2c-a881-e3ffffe63714-kube-api-access-t66qf\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:14.368754 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.368733 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp\" (UID: \"9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp" Nov 04 07:15:14.368849 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.368780 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-serving-cert\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:14.368849 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.368800 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-certificates\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.368949 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.368931 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tjsb\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-kube-api-access-9tjsb\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.369008 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.368973 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-tls\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.369008 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.368999 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vjds\" (UniqueName: \"kubernetes.io/projected/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-kube-api-access-9vjds\") pod \"cluster-samples-operator-6ddb6c8b94-jrqx8\" (UID: \"3ea0ef4d-2fdb-4090-965f-3db3237a4c69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" Nov 04 07:15:14.369103 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369026 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-ca-trust-extracted\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.369103 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369053 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-trusted-ca\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.369103 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369082 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-service-ca-bundle\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:14.369283 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.369100 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 07:15:14.369283 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.369125 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67f4948c94-mmrkw: secret "image-registry-tls" not found Nov 04 07:15:14.369283 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.369186 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-tls podName:aaff7a50-eb36-414b-a45e-5a0a56e3a8eb nodeName:}" failed. No retries permitted until 2026-11-04 07:15:14.869171797 +0000 UTC m=+30.641626428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-tls") pod "image-registry-67f4948c94-mmrkw" (UID: "aaff7a50-eb36-414b-a45e-5a0a56e3a8eb") : secret "image-registry-tls" not found Nov 04 07:15:14.369434 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369304 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-certificates\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.369434 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ecfd331a-08c4-43ac-a58c-9f43935d06ed-serving-cert\") pod \"console-operator-7cd56b8dbc-9k9rx\" (UID: \"ecfd331a-08c4-43ac-a58c-9f43935d06ed\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:14.369434 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369363 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w6vl\" (UniqueName: \"kubernetes.io/projected/9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb-kube-api-access-6w6vl\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp\" (UID: \"9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp" Nov 04 07:15:14.369434 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369407 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-jrqx8\" (UID: \"3ea0ef4d-2fdb-4090-965f-3db3237a4c69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" Nov 04 07:15:14.369627 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f9af642-8ada-4711-b1d1-e6b086e6b16c-config\") pod \"service-ca-operator-544d749c8c-qvdsw\" (UID: \"9f9af642-8ada-4711-b1d1-e6b086e6b16c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw" Nov 04 07:15:14.369627 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369463 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8v8x\" (UniqueName: \"kubernetes.io/projected/6652cbf0-521e-411b-9f75-2ce1f7c6a05b-kube-api-access-j8v8x\") pod \"ingress-canary-rtcv5\" (UID: \"6652cbf0-521e-411b-9f75-2ce1f7c6a05b\") " pod="openshift-ingress-canary/ingress-canary-rtcv5" Nov 04 07:15:14.369627 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369478 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-ca-trust-extracted\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.369627 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369496 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-installation-pull-secrets\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.369627 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369527 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-tmp\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:14.369627 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369558 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8deda5b1-d839-4a8b-b902-8e341ffe5340-config-volume\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:14.369627 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8deda5b1-d839-4a8b-b902-8e341ffe5340-metrics-tls\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:14.369627 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8deda5b1-d839-4a8b-b902-8e341ffe5340-tmp-dir\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:14.370012 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369636 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ecfd331a-08c4-43ac-a58c-9f43935d06ed-trusted-ca\") pod \"console-operator-7cd56b8dbc-9k9rx\" (UID: \"ecfd331a-08c4-43ac-a58c-9f43935d06ed\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:14.370012 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369686 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-986mn\" (UniqueName: \"kubernetes.io/projected/dfb5c54b-81e0-4f3a-92de-ea544696ee4b-kube-api-access-986mn\") pod \"network-check-source-6f78d59f99-9slp7\" (UID: \"dfb5c54b-81e0-4f3a-92de-ea544696ee4b\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-9slp7" Nov 04 07:15:14.370012 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369720 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-snapshots\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:14.370012 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369757 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6652cbf0-521e-411b-9f75-2ce1f7c6a05b-cert\") pod \"ingress-canary-rtcv5\" (UID: \"6652cbf0-521e-411b-9f75-2ce1f7c6a05b\") " pod="openshift-ingress-canary/ingress-canary-rtcv5" Nov 04 07:15:14.370012 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369784 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsp74\" (UniqueName: \"kubernetes.io/projected/8deda5b1-d839-4a8b-b902-8e341ffe5340-kube-api-access-zsp74\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:14.370012 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369811 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:14.370012 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369836 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-bound-sa-token\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.370012 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369873 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ecfd331a-08c4-43ac-a58c-9f43935d06ed-config\") pod \"console-operator-7cd56b8dbc-9k9rx\" (UID: \"ecfd331a-08c4-43ac-a58c-9f43935d06ed\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:14.370012 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369902 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfrm9\" (UniqueName: \"kubernetes.io/projected/07b0128a-5ba7-40f9-9f0c-fbfeae05b64e-kube-api-access-bfrm9\") pod \"volume-data-source-validator-58c9f5f46d-q8mhz\" (UID: \"07b0128a-5ba7-40f9-9f0c-fbfeae05b64e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-q8mhz" Nov 04 07:15:14.370012 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369930 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d8m5\" (UniqueName: \"kubernetes.io/projected/9f9af642-8ada-4711-b1d1-e6b086e6b16c-kube-api-access-4d8m5\") pod \"service-ca-operator-544d749c8c-qvdsw\" (UID: \"9f9af642-8ada-4711-b1d1-e6b086e6b16c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw" Nov 04 07:15:14.370012 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369959 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqzcl\" (UniqueName: \"kubernetes.io/projected/ecfd331a-08c4-43ac-a58c-9f43935d06ed-kube-api-access-vqzcl\") pod \"console-operator-7cd56b8dbc-9k9rx\" (UID: \"ecfd331a-08c4-43ac-a58c-9f43935d06ed\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:14.370012 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369984 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f9af642-8ada-4711-b1d1-e6b086e6b16c-config\") pod \"service-ca-operator-544d749c8c-qvdsw\" (UID: \"9f9af642-8ada-4711-b1d1-e6b086e6b16c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw" Nov 04 07:15:14.370617 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.370146 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-jrqx8\" (UID: \"3ea0ef4d-2fdb-4090-965f-3db3237a4c69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" Nov 04 07:15:14.371822 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.369986 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f9af642-8ada-4711-b1d1-e6b086e6b16c-serving-cert\") pod \"service-ca-operator-544d749c8c-qvdsw\" (UID: \"9f9af642-8ada-4711-b1d1-e6b086e6b16c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw" Nov 04 07:15:14.371822 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.371085 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-image-registry-private-configuration\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.371822 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.371125 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcs6z\" (UniqueName: \"kubernetes.io/projected/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-kube-api-access-pcs6z\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:14.371822 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.371171 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-nginx-conf\") pod \"networking-console-plugin-86c478bb88-vlsf6\" (UID: \"4e036a5c-ee3f-4b8f-a173-b3b6c052bca7\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-vlsf6" Nov 04 07:15:14.371822 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.371199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-vlsf6\" (UID: \"4e036a5c-ee3f-4b8f-a173-b3b6c052bca7\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-vlsf6" Nov 04 07:15:14.371822 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.371229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jrqx8\" (UID: \"3ea0ef4d-2fdb-4090-965f-3db3237a4c69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" Nov 04 07:15:14.371822 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.371256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp\" (UID: \"9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp" Nov 04 07:15:14.371822 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.371268 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-serving-cert\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:14.371822 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.371479 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp\" (UID: \"9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp" Nov 04 07:15:14.371822 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.371573 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-trusted-ca\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.372355 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.371912 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8deda5b1-d839-4a8b-b902-8e341ffe5340-tmp-dir\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:14.372355 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.371926 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ecfd331a-08c4-43ac-a58c-9f43935d06ed-trusted-ca\") pod \"console-operator-7cd56b8dbc-9k9rx\" (UID: \"ecfd331a-08c4-43ac-a58c-9f43935d06ed\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:14.372355 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.372046 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-tmp\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:14.372355 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.372113 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f9af642-8ada-4711-b1d1-e6b086e6b16c-serving-cert\") pod \"service-ca-operator-544d749c8c-qvdsw\" (UID: \"9f9af642-8ada-4711-b1d1-e6b086e6b16c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw" Nov 04 07:15:14.372355 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.372160 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 07:15:14.372355 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.372211 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8deda5b1-d839-4a8b-b902-8e341ffe5340-metrics-tls podName:8deda5b1-d839-4a8b-b902-8e341ffe5340 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:14.872196181 +0000 UTC m=+30.644650813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8deda5b1-d839-4a8b-b902-8e341ffe5340-metrics-tls") pod "dns-default-6x2rp" (UID: "8deda5b1-d839-4a8b-b902-8e341ffe5340") : secret "dns-default-metrics-tls" not found Nov 04 07:15:14.372355 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.372238 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-snapshots\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:14.372355 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.372282 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8deda5b1-d839-4a8b-b902-8e341ffe5340-config-volume\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:14.372355 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.372317 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 07:15:14.372355 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.372362 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-networking-console-plugin-cert podName:4e036a5c-ee3f-4b8f-a173-b3b6c052bca7 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:14.872348395 +0000 UTC m=+30.644803019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-vlsf6" (UID: "4e036a5c-ee3f-4b8f-a173-b3b6c052bca7") : secret "networking-console-plugin-cert" not found Nov 04 07:15:14.372669 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.372649 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp\" (UID: \"9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp" Nov 04 07:15:14.372704 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.372660 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-service-ca-bundle\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:14.372750 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.372733 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:14.372795 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.372774 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 07:15:14.372837 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.372818 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-tls podName:3ea0ef4d-2fdb-4090-965f-3db3237a4c69 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:14.872804591 +0000 UTC m=+30.645259218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-jrqx8" (UID: "3ea0ef4d-2fdb-4090-965f-3db3237a4c69") : secret "samples-operator-tls" not found Nov 04 07:15:14.372873 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.372854 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-nginx-conf\") pod \"networking-console-plugin-86c478bb88-vlsf6\" (UID: \"4e036a5c-ee3f-4b8f-a173-b3b6c052bca7\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-vlsf6" Nov 04 07:15:14.372964 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.372946 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ecfd331a-08c4-43ac-a58c-9f43935d06ed-serving-cert\") pod \"console-operator-7cd56b8dbc-9k9rx\" (UID: \"ecfd331a-08c4-43ac-a58c-9f43935d06ed\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:14.373121 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.373099 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ecfd331a-08c4-43ac-a58c-9f43935d06ed-config\") pod \"console-operator-7cd56b8dbc-9k9rx\" (UID: \"ecfd331a-08c4-43ac-a58c-9f43935d06ed\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:14.373399 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.373384 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-installation-pull-secrets\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.374193 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.374178 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6652cbf0-521e-411b-9f75-2ce1f7c6a05b-cert\") pod \"ingress-canary-rtcv5\" (UID: \"6652cbf0-521e-411b-9f75-2ce1f7c6a05b\") " pod="openshift-ingress-canary/ingress-canary-rtcv5" Nov 04 07:15:14.374308 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.374290 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-image-registry-private-configuration\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.386046 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.386026 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8v8x\" (UniqueName: \"kubernetes.io/projected/6652cbf0-521e-411b-9f75-2ce1f7c6a05b-kube-api-access-j8v8x\") pod \"ingress-canary-rtcv5\" (UID: \"6652cbf0-521e-411b-9f75-2ce1f7c6a05b\") " pod="openshift-ingress-canary/ingress-canary-rtcv5" Nov 04 07:15:14.389941 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.389312 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vjds\" (UniqueName: \"kubernetes.io/projected/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-kube-api-access-9vjds\") pod \"cluster-samples-operator-6ddb6c8b94-jrqx8\" (UID: \"3ea0ef4d-2fdb-4090-965f-3db3237a4c69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" Nov 04 07:15:14.389941 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.389803 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-bound-sa-token\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.389941 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.389869 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqzcl\" (UniqueName: \"kubernetes.io/projected/ecfd331a-08c4-43ac-a58c-9f43935d06ed-kube-api-access-vqzcl\") pod \"console-operator-7cd56b8dbc-9k9rx\" (UID: \"ecfd331a-08c4-43ac-a58c-9f43935d06ed\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:14.389941 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.389876 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcs6z\" (UniqueName: \"kubernetes.io/projected/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-kube-api-access-pcs6z\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:14.390198 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.389971 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w6vl\" (UniqueName: \"kubernetes.io/projected/9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb-kube-api-access-6w6vl\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp\" (UID: \"9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp" Nov 04 07:15:14.390198 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.390071 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsp74\" (UniqueName: \"kubernetes.io/projected/8deda5b1-d839-4a8b-b902-8e341ffe5340-kube-api-access-zsp74\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:14.390399 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.390380 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfrm9\" (UniqueName: \"kubernetes.io/projected/07b0128a-5ba7-40f9-9f0c-fbfeae05b64e-kube-api-access-bfrm9\") pod \"volume-data-source-validator-58c9f5f46d-q8mhz\" (UID: \"07b0128a-5ba7-40f9-9f0c-fbfeae05b64e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-q8mhz" Nov 04 07:15:14.390674 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.390654 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-986mn\" (UniqueName: \"kubernetes.io/projected/dfb5c54b-81e0-4f3a-92de-ea544696ee4b-kube-api-access-986mn\") pod \"network-check-source-6f78d59f99-9slp7\" (UID: \"dfb5c54b-81e0-4f3a-92de-ea544696ee4b\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-9slp7" Nov 04 07:15:14.390728 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.390672 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d8m5\" (UniqueName: \"kubernetes.io/projected/9f9af642-8ada-4711-b1d1-e6b086e6b16c-kube-api-access-4d8m5\") pod \"service-ca-operator-544d749c8c-qvdsw\" (UID: \"9f9af642-8ada-4711-b1d1-e6b086e6b16c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw" Nov 04 07:15:14.391516 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.391498 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tjsb\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-kube-api-access-9tjsb\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.394205 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.394187 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-kfsw5" Nov 04 07:15:14.401880 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.401863 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-smsdz" Nov 04 07:15:14.408671 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.408651 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-wzwrl" Nov 04 07:15:14.451884 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.451853 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:14.461426 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.461271 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-q8mhz" Nov 04 07:15:14.467701 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.467633 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw" Nov 04 07:15:14.472480 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.472464 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp" Nov 04 07:15:14.492751 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.492522 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:14.509442 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.503271 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-9slp7" Nov 04 07:15:14.511664 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.511260 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rtcv5" Nov 04 07:15:14.695187 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.695156 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-kfsw5"] Nov 04 07:15:14.699339 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.699316 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-smsdz"] Nov 04 07:15:14.701993 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.699830 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-wzwrl"] Nov 04 07:15:14.705085 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:15:14.705059 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod712361a9_8da4_4367_b3e9_a60bdc909482.slice/crio-e33bf94ac1cc337ed6f00b8bc0472da4e99b8dce7986547978993fc0385482e7 WatchSource:0}: Error finding container e33bf94ac1cc337ed6f00b8bc0472da4e99b8dce7986547978993fc0385482e7: Status 404 returned error can't find the container with id e33bf94ac1cc337ed6f00b8bc0472da4e99b8dce7986547978993fc0385482e7 Nov 04 07:15:14.775551 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.775245 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-tls\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:14.775551 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.775327 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:14.775551 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.775356 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 07:15:14.775551 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.775372 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f12932cd-facc-4cf2-bd45-d359ae6d6012-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-hb4ng\" (UID: \"f12932cd-facc-4cf2-bd45-d359ae6d6012\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng" Nov 04 07:15:14.775551 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.775433 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-metrics-certs\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:14.776227 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.775379 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f5799855-6xlbc: secret "image-registry-tls" not found Nov 04 07:15:14.776227 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.775689 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 07:15:14.776227 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.775481 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle podName:c96c91ba-0da0-4c2c-a881-e3ffffe63714 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:15.775460786 +0000 UTC m=+31.547915419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle") pod "router-default-6d87c68c59-n7zhf" (UID: "c96c91ba-0da0-4c2c-a881-e3ffffe63714") : configmap references non-existent config key: service-ca.crt Nov 04 07:15:14.776227 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.776007 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f12932cd-facc-4cf2-bd45-d359ae6d6012-cluster-monitoring-operator-tls podName:f12932cd-facc-4cf2-bd45-d359ae6d6012 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:15.775989413 +0000 UTC m=+31.548444033 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f12932cd-facc-4cf2-bd45-d359ae6d6012-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-hb4ng" (UID: "f12932cd-facc-4cf2-bd45-d359ae6d6012") : secret "cluster-monitoring-operator-tls" not found Nov 04 07:15:14.776227 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.775676 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 07:15:14.776227 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.776055 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-metrics-certs podName:c96c91ba-0da0-4c2c-a881-e3ffffe63714 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:15.776044578 +0000 UTC m=+31.548499225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-metrics-certs") pod "router-default-6d87c68c59-n7zhf" (UID: "c96c91ba-0da0-4c2c-a881-e3ffffe63714") : secret "router-metrics-certs-default" not found Nov 04 07:15:14.777180 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.777159 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-tls podName:fb5b977d-e13b-4499-8f7d-57b96f1b62bb nodeName:}" failed. No retries permitted until 2026-11-04 07:15:15.777122003 +0000 UTC m=+31.549576634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-tls") pod "image-registry-85f5799855-6xlbc" (UID: "fb5b977d-e13b-4499-8f7d-57b96f1b62bb") : secret "image-registry-tls" not found Nov 04 07:15:14.779857 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.779793 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-p5lnr"] Nov 04 07:15:14.785346 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:15:14.784740 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1971526_e34c_4dd8_9c6c_b6d9d13356c1.slice/crio-b0ca8bec3585448148dcd43a929691b6def5d189b1a76f8b574ee5bcfe17b560 WatchSource:0}: Error finding container b0ca8bec3585448148dcd43a929691b6def5d189b1a76f8b574ee5bcfe17b560: Status 404 returned error can't find the container with id b0ca8bec3585448148dcd43a929691b6def5d189b1a76f8b574ee5bcfe17b560 Nov 04 07:15:14.794805 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.794772 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw"] Nov 04 07:15:14.800268 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:15:14.800241 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f9af642_8ada_4711_b1d1_e6b086e6b16c.slice/crio-abb5e5022356a91e742ca81e5b0daa931b63397a11a014376bbce87e3e906351 WatchSource:0}: Error finding container abb5e5022356a91e742ca81e5b0daa931b63397a11a014376bbce87e3e906351: Status 404 returned error can't find the container with id abb5e5022356a91e742ca81e5b0daa931b63397a11a014376bbce87e3e906351 Nov 04 07:15:14.829349 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.828876 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp"] Nov 04 07:15:14.831560 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.831408 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rtcv5"] Nov 04 07:15:14.833161 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:15:14.833068 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a7c1c3f_c12e_4bcc_966d_79f5f08a97bb.slice/crio-2df83fc70ff880f345617e1601fd274fa84ef1b27285fc59dd1d35322f18bb96 WatchSource:0}: Error finding container 2df83fc70ff880f345617e1601fd274fa84ef1b27285fc59dd1d35322f18bb96: Status 404 returned error can't find the container with id 2df83fc70ff880f345617e1601fd274fa84ef1b27285fc59dd1d35322f18bb96 Nov 04 07:15:14.835654 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:15:14.835606 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6652cbf0_521e_411b_9f75_2ce1f7c6a05b.slice/crio-80a1e3efdec7f95f504d8f4e3d76dc4541de9124562f0ffaf71d558ef1eb3b52 WatchSource:0}: Error finding container 80a1e3efdec7f95f504d8f4e3d76dc4541de9124562f0ffaf71d558ef1eb3b52: Status 404 returned error can't find the container with id 80a1e3efdec7f95f504d8f4e3d76dc4541de9124562f0ffaf71d558ef1eb3b52 Nov 04 07:15:14.859874 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.859852 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-9k9rx"] Nov 04 07:15:14.861828 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:15:14.861807 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecfd331a_08c4_43ac_a58c_9f43935d06ed.slice/crio-6e4c81aeb7973fa6dc7d2b60da9378efed9a2d479b50b606f15e5f2f7797f907 WatchSource:0}: Error finding container 6e4c81aeb7973fa6dc7d2b60da9378efed9a2d479b50b606f15e5f2f7797f907: Status 404 returned error can't find the container with id 6e4c81aeb7973fa6dc7d2b60da9378efed9a2d479b50b606f15e5f2f7797f907 Nov 04 07:15:14.872178 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.872075 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-q8mhz"] Nov 04 07:15:14.874507 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:15:14.874485 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07b0128a_5ba7_40f9_9f0c_fbfeae05b64e.slice/crio-25f6f050986aedbcf4339b6d2b4ccaadab5a6669ce45c64e391320f81ac406f6 WatchSource:0}: Error finding container 25f6f050986aedbcf4339b6d2b4ccaadab5a6669ce45c64e391320f81ac406f6: Status 404 returned error can't find the container with id 25f6f050986aedbcf4339b6d2b4ccaadab5a6669ce45c64e391320f81ac406f6 Nov 04 07:15:14.875426 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.875407 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-9slp7"] Nov 04 07:15:14.876983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.876482 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8deda5b1-d839-4a8b-b902-8e341ffe5340-metrics-tls\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:14.876983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.876617 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-vlsf6\" (UID: \"4e036a5c-ee3f-4b8f-a173-b3b6c052bca7\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-vlsf6" Nov 04 07:15:14.876983 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.876630 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 07:15:14.876983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.876639 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jrqx8\" (UID: \"3ea0ef4d-2fdb-4090-965f-3db3237a4c69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" Nov 04 07:15:14.876983 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.876688 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8deda5b1-d839-4a8b-b902-8e341ffe5340-metrics-tls podName:8deda5b1-d839-4a8b-b902-8e341ffe5340 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:15.876668515 +0000 UTC m=+31.649123130 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8deda5b1-d839-4a8b-b902-8e341ffe5340-metrics-tls") pod "dns-default-6x2rp" (UID: "8deda5b1-d839-4a8b-b902-8e341ffe5340") : secret "dns-default-metrics-tls" not found Nov 04 07:15:14.876983 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.876739 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 07:15:14.876983 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.876735 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-tls\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:14.876983 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.876739 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 07:15:14.876983 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.876789 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-networking-console-plugin-cert podName:4e036a5c-ee3f-4b8f-a173-b3b6c052bca7 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:15.87677471 +0000 UTC m=+31.649229327 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-vlsf6" (UID: "4e036a5c-ee3f-4b8f-a173-b3b6c052bca7") : secret "networking-console-plugin-cert" not found Nov 04 07:15:14.876983 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.876824 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 07:15:14.876983 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.876838 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67f4948c94-mmrkw: secret "image-registry-tls" not found Nov 04 07:15:14.876983 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.876826 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-tls podName:3ea0ef4d-2fdb-4090-965f-3db3237a4c69 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:15.876809627 +0000 UTC m=+31.649264257 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-jrqx8" (UID: "3ea0ef4d-2fdb-4090-965f-3db3237a4c69") : secret "samples-operator-tls" not found Nov 04 07:15:14.876983 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:14.876935 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-tls podName:aaff7a50-eb36-414b-a45e-5a0a56e3a8eb nodeName:}" failed. No retries permitted until 2026-11-04 07:15:15.876919546 +0000 UTC m=+31.649374158 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-tls") pod "image-registry-67f4948c94-mmrkw" (UID: "aaff7a50-eb36-414b-a45e-5a0a56e3a8eb") : secret "image-registry-tls" not found Nov 04 07:15:14.878503 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:15:14.878469 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfb5c54b_81e0_4f3a_92de_ea544696ee4b.slice/crio-7ad20a10acc9272f7fa52fe175b8f2f275161c825207f71376292e64cf05cf56 WatchSource:0}: Error finding container 7ad20a10acc9272f7fa52fe175b8f2f275161c825207f71376292e64cf05cf56: Status 404 returned error can't find the container with id 7ad20a10acc9272f7fa52fe175b8f2f275161c825207f71376292e64cf05cf56 Nov 04 07:15:14.977666 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.977640 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rtcv5" event={"ID":"6652cbf0-521e-411b-9f75-2ce1f7c6a05b","Type":"ContainerStarted","Data":"80a1e3efdec7f95f504d8f4e3d76dc4541de9124562f0ffaf71d558ef1eb3b52"} Nov 04 07:15:14.978732 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.978713 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-9slp7" event={"ID":"dfb5c54b-81e0-4f3a-92de-ea544696ee4b","Type":"ContainerStarted","Data":"7ad20a10acc9272f7fa52fe175b8f2f275161c825207f71376292e64cf05cf56"} Nov 04 07:15:14.979814 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.979795 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" event={"ID":"ecfd331a-08c4-43ac-a58c-9f43935d06ed","Type":"ContainerStarted","Data":"6e4c81aeb7973fa6dc7d2b60da9378efed9a2d479b50b606f15e5f2f7797f907"} Nov 04 07:15:14.980797 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.980779 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp" event={"ID":"9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb","Type":"ContainerStarted","Data":"2df83fc70ff880f345617e1601fd274fa84ef1b27285fc59dd1d35322f18bb96"} Nov 04 07:15:14.981837 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.981807 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw" event={"ID":"9f9af642-8ada-4711-b1d1-e6b086e6b16c","Type":"ContainerStarted","Data":"abb5e5022356a91e742ca81e5b0daa931b63397a11a014376bbce87e3e906351"} Nov 04 07:15:14.982910 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.982885 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-p5lnr" event={"ID":"a1971526-e34c-4dd8-9c6c-b6d9d13356c1","Type":"ContainerStarted","Data":"b0ca8bec3585448148dcd43a929691b6def5d189b1a76f8b574ee5bcfe17b560"} Nov 04 07:15:14.984303 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.984283 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-wzwrl" event={"ID":"712361a9-8da4-4367-b3e9-a60bdc909482","Type":"ContainerStarted","Data":"d96db139353e8c18f5d188fd21b7294f29990524f90f5d52dc6d45fd58ad84a9"} Nov 04 07:15:14.984378 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.984316 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-wzwrl" event={"ID":"712361a9-8da4-4367-b3e9-a60bdc909482","Type":"ContainerStarted","Data":"e33bf94ac1cc337ed6f00b8bc0472da4e99b8dce7986547978993fc0385482e7"} Nov 04 07:15:14.985658 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.985641 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-kfsw5" event={"ID":"5240a510-6179-45d9-bb60-b3fc3054e304","Type":"ContainerStarted","Data":"6da37e4e1281c4e8548546cef3df8f9bd0ed4b412c1eb8502c5915d647a2032f"} Nov 04 07:15:14.985723 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.985670 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-kfsw5" event={"ID":"5240a510-6179-45d9-bb60-b3fc3054e304","Type":"ContainerStarted","Data":"c24c19ef0235a10cb63a95a64160ae01699f6714fcd174b2bb5dede7588aa44b"} Nov 04 07:15:14.986734 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.986716 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-q8mhz" event={"ID":"07b0128a-5ba7-40f9-9f0c-fbfeae05b64e","Type":"ContainerStarted","Data":"25f6f050986aedbcf4339b6d2b4ccaadab5a6669ce45c64e391320f81ac406f6"} Nov 04 07:15:14.987921 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.987900 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-smsdz" event={"ID":"6307c016-6fa4-4890-a9e5-0a0ad2f4a484","Type":"ContainerStarted","Data":"f8c60d881b5434e6ef78e12ee0a3ecee5679d1ab5b88c2a1965e81c7c022366b"} Nov 04 07:15:14.987982 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:14.987973 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-smsdz" event={"ID":"6307c016-6fa4-4890-a9e5-0a0ad2f4a484","Type":"ContainerStarted","Data":"628a302969088018110ee7753e32b4aa8d4f39da39b0832a0b8d819727307854"} Nov 04 07:15:15.006250 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:15.003642 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-wzwrl" podStartSLOduration=415.003626768 podStartE2EDuration="6m55.003626768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:08:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:15:15.002671564 +0000 UTC m=+30.775126202" watchObservedRunningTime="2026-11-04 07:15:15.003626768 +0000 UTC m=+30.776081408" Nov 04 07:15:15.021022 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:15.020988 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-kfsw5" podStartSLOduration=415.020978189 podStartE2EDuration="6m55.020978189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:08:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:15:15.020801401 +0000 UTC m=+30.793256038" watchObservedRunningTime="2026-11-04 07:15:15.020978189 +0000 UTC m=+30.793432825" Nov 04 07:15:15.039466 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:15.039430 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-smsdz" podStartSLOduration=415.039420839 podStartE2EDuration="6m55.039420839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:08:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:15:15.038681029 +0000 UTC m=+30.811135666" watchObservedRunningTime="2026-11-04 07:15:15.039420839 +0000 UTC m=+30.811875471" Nov 04 07:15:15.735286 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:15.735254 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:15:15.735286 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:15.735280 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:15:15.735506 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:15.735491 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:15:15.745646 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:15.744765 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-hvg8n\"" Nov 04 07:15:15.745646 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:15.744935 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gnthh\"" Nov 04 07:15:15.745646 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:15.744991 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 04 07:15:15.746100 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:15.746052 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-zw52p\"" Nov 04 07:15:15.746712 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:15.746684 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 04 07:15:15.786994 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:15.786028 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-tls\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:15.786994 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:15.786097 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:15.786994 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:15.786155 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f12932cd-facc-4cf2-bd45-d359ae6d6012-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-hb4ng\" (UID: \"f12932cd-facc-4cf2-bd45-d359ae6d6012\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng" Nov 04 07:15:15.786994 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:15.786209 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-metrics-certs\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:15.786994 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:15.786325 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 07:15:15.786994 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:15.786378 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-metrics-certs podName:c96c91ba-0da0-4c2c-a881-e3ffffe63714 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:17.786361021 +0000 UTC m=+33.558815639 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-metrics-certs") pod "router-default-6d87c68c59-n7zhf" (UID: "c96c91ba-0da0-4c2c-a881-e3ffffe63714") : secret "router-metrics-certs-default" not found Nov 04 07:15:15.786994 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:15.786749 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 07:15:15.786994 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:15.786764 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f5799855-6xlbc: secret "image-registry-tls" not found Nov 04 07:15:15.786994 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:15.786807 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-tls podName:fb5b977d-e13b-4499-8f7d-57b96f1b62bb nodeName:}" failed. No retries permitted until 2026-11-04 07:15:17.786792111 +0000 UTC m=+33.559246745 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-tls") pod "image-registry-85f5799855-6xlbc" (UID: "fb5b977d-e13b-4499-8f7d-57b96f1b62bb") : secret "image-registry-tls" not found Nov 04 07:15:15.786994 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:15.786874 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle podName:c96c91ba-0da0-4c2c-a881-e3ffffe63714 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:17.786864475 +0000 UTC m=+33.559319102 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle") pod "router-default-6d87c68c59-n7zhf" (UID: "c96c91ba-0da0-4c2c-a881-e3ffffe63714") : configmap references non-existent config key: service-ca.crt Nov 04 07:15:15.786994 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:15.786933 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 07:15:15.786994 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:15.786964 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f12932cd-facc-4cf2-bd45-d359ae6d6012-cluster-monitoring-operator-tls podName:f12932cd-facc-4cf2-bd45-d359ae6d6012 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:17.786953983 +0000 UTC m=+33.559408610 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f12932cd-facc-4cf2-bd45-d359ae6d6012-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-hb4ng" (UID: "f12932cd-facc-4cf2-bd45-d359ae6d6012") : secret "cluster-monitoring-operator-tls" not found Nov 04 07:15:15.887044 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:15.887006 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-vlsf6\" (UID: \"4e036a5c-ee3f-4b8f-a173-b3b6c052bca7\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-vlsf6" Nov 04 07:15:15.887231 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:15.887055 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jrqx8\" (UID: \"3ea0ef4d-2fdb-4090-965f-3db3237a4c69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" Nov 04 07:15:15.887231 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:15.887204 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-tls\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:15.887349 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:15.887272 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8deda5b1-d839-4a8b-b902-8e341ffe5340-metrics-tls\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:15.888771 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:15.887922 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 07:15:15.888771 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:15.887987 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-networking-console-plugin-cert podName:4e036a5c-ee3f-4b8f-a173-b3b6c052bca7 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:17.887969296 +0000 UTC m=+33.660423912 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-vlsf6" (UID: "4e036a5c-ee3f-4b8f-a173-b3b6c052bca7") : secret "networking-console-plugin-cert" not found Nov 04 07:15:15.888771 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:15.888398 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 07:15:15.888771 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:15.888448 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-tls podName:3ea0ef4d-2fdb-4090-965f-3db3237a4c69 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:17.888433432 +0000 UTC m=+33.660888049 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-jrqx8" (UID: "3ea0ef4d-2fdb-4090-965f-3db3237a4c69") : secret "samples-operator-tls" not found Nov 04 07:15:15.888771 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:15.888554 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 07:15:15.888771 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:15.888566 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67f4948c94-mmrkw: secret "image-registry-tls" not found Nov 04 07:15:15.888771 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:15.888599 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-tls podName:aaff7a50-eb36-414b-a45e-5a0a56e3a8eb nodeName:}" failed. No retries permitted until 2026-11-04 07:15:17.888588295 +0000 UTC m=+33.661042911 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-tls") pod "image-registry-67f4948c94-mmrkw" (UID: "aaff7a50-eb36-414b-a45e-5a0a56e3a8eb") : secret "image-registry-tls" not found Nov 04 07:15:15.888771 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:15.888663 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 07:15:15.888771 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:15.888696 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8deda5b1-d839-4a8b-b902-8e341ffe5340-metrics-tls podName:8deda5b1-d839-4a8b-b902-8e341ffe5340 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:17.88868541 +0000 UTC m=+33.661140026 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8deda5b1-d839-4a8b-b902-8e341ffe5340-metrics-tls") pod "dns-default-6x2rp" (UID: "8deda5b1-d839-4a8b-b902-8e341ffe5340") : secret "dns-default-metrics-tls" not found Nov 04 07:15:17.807751 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:17.807714 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f12932cd-facc-4cf2-bd45-d359ae6d6012-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-hb4ng\" (UID: \"f12932cd-facc-4cf2-bd45-d359ae6d6012\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng" Nov 04 07:15:17.808329 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:17.807782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-metrics-certs\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:17.808329 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:17.807906 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-tls\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:17.808329 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:17.807962 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:17.808329 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:17.808119 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle podName:c96c91ba-0da0-4c2c-a881-e3ffffe63714 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:21.808102054 +0000 UTC m=+37.580556668 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle") pod "router-default-6d87c68c59-n7zhf" (UID: "c96c91ba-0da0-4c2c-a881-e3ffffe63714") : configmap references non-existent config key: service-ca.crt Nov 04 07:15:17.808577 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:17.808558 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 07:15:17.808636 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:17.808618 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f12932cd-facc-4cf2-bd45-d359ae6d6012-cluster-monitoring-operator-tls podName:f12932cd-facc-4cf2-bd45-d359ae6d6012 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:21.808602232 +0000 UTC m=+37.581056862 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f12932cd-facc-4cf2-bd45-d359ae6d6012-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-hb4ng" (UID: "f12932cd-facc-4cf2-bd45-d359ae6d6012") : secret "cluster-monitoring-operator-tls" not found Nov 04 07:15:17.808698 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:17.808678 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 07:15:17.808749 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:17.808712 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-metrics-certs podName:c96c91ba-0da0-4c2c-a881-e3ffffe63714 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:21.808701738 +0000 UTC m=+37.581156353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-metrics-certs") pod "router-default-6d87c68c59-n7zhf" (UID: "c96c91ba-0da0-4c2c-a881-e3ffffe63714") : secret "router-metrics-certs-default" not found Nov 04 07:15:17.808810 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:17.808779 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 07:15:17.808810 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:17.808791 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f5799855-6xlbc: secret "image-registry-tls" not found Nov 04 07:15:17.808902 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:17.808826 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-tls podName:fb5b977d-e13b-4499-8f7d-57b96f1b62bb nodeName:}" failed. No retries permitted until 2026-11-04 07:15:21.808812845 +0000 UTC m=+37.581267461 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-tls") pod "image-registry-85f5799855-6xlbc" (UID: "fb5b977d-e13b-4499-8f7d-57b96f1b62bb") : secret "image-registry-tls" not found Nov 04 07:15:17.910572 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:17.909409 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-tls\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:17.910572 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:17.909497 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8deda5b1-d839-4a8b-b902-8e341ffe5340-metrics-tls\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:17.910572 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:17.909614 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-vlsf6\" (UID: \"4e036a5c-ee3f-4b8f-a173-b3b6c052bca7\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-vlsf6" Nov 04 07:15:17.910572 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:17.909643 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jrqx8\" (UID: \"3ea0ef4d-2fdb-4090-965f-3db3237a4c69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" Nov 04 07:15:17.910572 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:17.909788 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 07:15:17.910572 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:17.909848 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-tls podName:3ea0ef4d-2fdb-4090-965f-3db3237a4c69 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:21.909830388 +0000 UTC m=+37.682285023 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-jrqx8" (UID: "3ea0ef4d-2fdb-4090-965f-3db3237a4c69") : secret "samples-operator-tls" not found Nov 04 07:15:17.910572 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:17.909918 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 07:15:17.910572 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:17.909929 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67f4948c94-mmrkw: secret "image-registry-tls" not found Nov 04 07:15:17.910572 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:17.909960 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-tls podName:aaff7a50-eb36-414b-a45e-5a0a56e3a8eb nodeName:}" failed. No retries permitted until 2026-11-04 07:15:21.909949696 +0000 UTC m=+37.682404327 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-tls") pod "image-registry-67f4948c94-mmrkw" (UID: "aaff7a50-eb36-414b-a45e-5a0a56e3a8eb") : secret "image-registry-tls" not found Nov 04 07:15:17.910572 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:17.910021 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 07:15:17.910572 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:17.910059 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8deda5b1-d839-4a8b-b902-8e341ffe5340-metrics-tls podName:8deda5b1-d839-4a8b-b902-8e341ffe5340 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:21.910040466 +0000 UTC m=+37.682495092 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8deda5b1-d839-4a8b-b902-8e341ffe5340-metrics-tls") pod "dns-default-6x2rp" (UID: "8deda5b1-d839-4a8b-b902-8e341ffe5340") : secret "dns-default-metrics-tls" not found Nov 04 07:15:17.910572 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:17.910115 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 07:15:17.910572 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:17.910160 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-networking-console-plugin-cert podName:4e036a5c-ee3f-4b8f-a173-b3b6c052bca7 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:21.910149821 +0000 UTC m=+37.682604449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-vlsf6" (UID: "4e036a5c-ee3f-4b8f-a173-b3b6c052bca7") : secret "networking-console-plugin-cert" not found Nov 04 07:15:18.005532 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:18.005466 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-q8mhz" event={"ID":"07b0128a-5ba7-40f9-9f0c-fbfeae05b64e","Type":"ContainerStarted","Data":"df98b6807e01481172b5682da459c587d3dadb763cfe7cd151be506e2244c31e"} Nov 04 07:15:18.027908 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:18.027848 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-q8mhz" podStartSLOduration=378.695056169 podStartE2EDuration="6m21.027828703s" totalImagesPullingTime="2.332772534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:08:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:15:18.0247496 +0000 UTC m=+33.797204239" watchObservedRunningTime="2026-11-04 07:15:18.027828703 +0000 UTC m=+33.800283338" Nov 04 07:15:18.416542 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:18.416488 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa159b4a-95ad-4a99-ae91-995c34fc44c1-original-pull-secret\") pod \"global-pull-secret-syncer-dh9b9\" (UID: \"aa159b4a-95ad-4a99-ae91-995c34fc44c1\") " pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:15:18.416749 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:18.416606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmp9d\" (UniqueName: \"kubernetes.io/projected/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd-kube-api-access-lmp9d\") pod \"network-check-target-rq9pn\" (UID: \"0acaaee7-9bc3-499b-ba3f-50cc5d7498fd\") " pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:15:18.416749 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:18.416669 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs\") pod \"network-metrics-daemon-xxcn8\" (UID: \"706127dc-f1c4-4724-aa56-ba5c5623bcf4\") " pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:15:18.417877 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:18.417447 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Nov 04 07:15:18.417877 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:18.417531 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs podName:706127dc-f1c4-4724-aa56-ba5c5623bcf4 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:50.417512175 +0000 UTC m=+66.189966802 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs") pod "network-metrics-daemon-xxcn8" (UID: "706127dc-f1c4-4724-aa56-ba5c5623bcf4") : secret "metrics-daemon-secret" not found Nov 04 07:15:18.423584 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:18.420536 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa159b4a-95ad-4a99-ae91-995c34fc44c1-original-pull-secret\") pod \"global-pull-secret-syncer-dh9b9\" (UID: \"aa159b4a-95ad-4a99-ae91-995c34fc44c1\") " pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:15:18.423584 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:18.422004 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmp9d\" (UniqueName: \"kubernetes.io/projected/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd-kube-api-access-lmp9d\") pod \"network-check-target-rq9pn\" (UID: \"0acaaee7-9bc3-499b-ba3f-50cc5d7498fd\") " pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:15:18.511464 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:18.511426 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:15:18.524082 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:18.524022 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:15:18.850196 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:18.850167 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dh9b9"] Nov 04 07:15:18.854087 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:15:18.854060 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa159b4a_95ad_4a99_ae91_995c34fc44c1.slice/crio-5ab9f81141bc38e61168c61ad91076177308c680deb60704c5165939a7a0ef50 WatchSource:0}: Error finding container 5ab9f81141bc38e61168c61ad91076177308c680deb60704c5165939a7a0ef50: Status 404 returned error can't find the container with id 5ab9f81141bc38e61168c61ad91076177308c680deb60704c5165939a7a0ef50 Nov 04 07:15:18.882227 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:18.882196 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rq9pn"] Nov 04 07:15:18.892084 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:15:18.892053 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0acaaee7_9bc3_499b_ba3f_50cc5d7498fd.slice/crio-9cdb734c69b80aaf29929edda6f94465bafa716d7d6a3dceda6c297013404b75 WatchSource:0}: Error finding container 9cdb734c69b80aaf29929edda6f94465bafa716d7d6a3dceda6c297013404b75: Status 404 returned error can't find the container with id 9cdb734c69b80aaf29929edda6f94465bafa716d7d6a3dceda6c297013404b75 Nov 04 07:15:19.014488 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:19.014368 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rq9pn" event={"ID":"0acaaee7-9bc3-499b-ba3f-50cc5d7498fd","Type":"ContainerStarted","Data":"9cdb734c69b80aaf29929edda6f94465bafa716d7d6a3dceda6c297013404b75"} Nov 04 07:15:19.018243 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:19.017743 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp" event={"ID":"9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb","Type":"ContainerStarted","Data":"8446faffe2312fd51f23a50b7feeffbd7b27e8e6ddf57096cb6b148b028e0096"} Nov 04 07:15:19.020614 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:19.020585 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dh9b9" event={"ID":"aa159b4a-95ad-4a99-ae91-995c34fc44c1","Type":"ContainerStarted","Data":"5ab9f81141bc38e61168c61ad91076177308c680deb60704c5165939a7a0ef50"} Nov 04 07:15:19.049623 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:19.049574 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp" podStartSLOduration=378.135861063 podStartE2EDuration="6m22.04956044s" totalImagesPullingTime="3.913699377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:08:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:15:19.049478778 +0000 UTC m=+34.821933414" watchObservedRunningTime="2026-11-04 07:15:19.04956044 +0000 UTC m=+34.822015075" Nov 04 07:15:19.715670 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:19.715636 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-tlcjg"] Nov 04 07:15:19.734944 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:19.734883 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-hh854"] Nov 04 07:15:19.735105 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:19.735025 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-tlcjg" Nov 04 07:15:19.747888 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:19.747862 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Nov 04 07:15:19.748025 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:19.747932 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Nov 04 07:15:19.749193 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:19.749170 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5h9h4\"" Nov 04 07:15:19.753930 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:19.753899 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-tlcjg"] Nov 04 07:15:19.754079 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:19.753952 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-hh854"] Nov 04 07:15:19.754079 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:19.754027 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hh854" Nov 04 07:15:19.839488 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:19.839449 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2bsc\" (UniqueName: \"kubernetes.io/projected/20da56ab-0718-406e-80c4-d8fb20ac7049-kube-api-access-s2bsc\") pod \"migrator-66df5d496b-tlcjg\" (UID: \"20da56ab-0718-406e-80c4-d8fb20ac7049\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-tlcjg" Nov 04 07:15:19.940365 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:19.940336 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh729\" (UniqueName: \"kubernetes.io/projected/5977e1b4-8c3a-42b7-8e3a-e152fd907bd4-kube-api-access-nh729\") pod \"migrator-66df5d496b-hh854\" (UID: \"5977e1b4-8c3a-42b7-8e3a-e152fd907bd4\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hh854" Nov 04 07:15:19.940772 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:19.940382 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2bsc\" (UniqueName: \"kubernetes.io/projected/20da56ab-0718-406e-80c4-d8fb20ac7049-kube-api-access-s2bsc\") pod \"migrator-66df5d496b-tlcjg\" (UID: \"20da56ab-0718-406e-80c4-d8fb20ac7049\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-tlcjg" Nov 04 07:15:19.953416 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:19.953392 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2bsc\" (UniqueName: \"kubernetes.io/projected/20da56ab-0718-406e-80c4-d8fb20ac7049-kube-api-access-s2bsc\") pod \"migrator-66df5d496b-tlcjg\" (UID: \"20da56ab-0718-406e-80c4-d8fb20ac7049\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-tlcjg" Nov 04 07:15:20.041360 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:20.041298 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh729\" (UniqueName: \"kubernetes.io/projected/5977e1b4-8c3a-42b7-8e3a-e152fd907bd4-kube-api-access-nh729\") pod \"migrator-66df5d496b-hh854\" (UID: \"5977e1b4-8c3a-42b7-8e3a-e152fd907bd4\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hh854" Nov 04 07:15:20.054750 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:20.054680 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh729\" (UniqueName: \"kubernetes.io/projected/5977e1b4-8c3a-42b7-8e3a-e152fd907bd4-kube-api-access-nh729\") pod \"migrator-66df5d496b-hh854\" (UID: \"5977e1b4-8c3a-42b7-8e3a-e152fd907bd4\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hh854" Nov 04 07:15:20.057492 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:20.057470 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-tlcjg" Nov 04 07:15:20.087847 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:20.087675 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hh854" Nov 04 07:15:20.415667 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:20.415634 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-tlcjg"] Nov 04 07:15:20.426996 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:20.426922 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-hh854"] Nov 04 07:15:20.470391 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:15:20.470359 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20da56ab_0718_406e_80c4_d8fb20ac7049.slice/crio-959ced276b531432be7722c74bba5d2693d5ab4f70dd8f061304eba6968b0bf4 WatchSource:0}: Error finding container 959ced276b531432be7722c74bba5d2693d5ab4f70dd8f061304eba6968b0bf4: Status 404 returned error can't find the container with id 959ced276b531432be7722c74bba5d2693d5ab4f70dd8f061304eba6968b0bf4 Nov 04 07:15:20.915795 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:20.915769 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nx4xj"] Nov 04 07:15:20.937935 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:20.937912 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nx4xj"] Nov 04 07:15:20.938091 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:20.938078 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:20.951039 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:20.950939 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 04 07:15:20.952245 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:20.952036 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9lks7\"" Nov 04 07:15:20.954330 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:20.953056 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-twnww-hrp7j"] Nov 04 07:15:20.958734 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:20.958695 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 04 07:15:20.972306 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:20.972000 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-twnww-hrp7j" Nov 04 07:15:20.982742 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:20.982616 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-twnww-hrp7j"] Nov 04 07:15:21.031456 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.031392 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-tlcjg" event={"ID":"20da56ab-0718-406e-80c4-d8fb20ac7049","Type":"ContainerStarted","Data":"959ced276b531432be7722c74bba5d2693d5ab4f70dd8f061304eba6968b0bf4"} Nov 04 07:15:21.034703 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.034045 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rtcv5" event={"ID":"6652cbf0-521e-411b-9f75-2ce1f7c6a05b","Type":"ContainerStarted","Data":"15ea67b16ec56f32270518eaf28c4a71c329a2aab811f365ff4bdae14543d03e"} Nov 04 07:15:21.037617 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.037597 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-9slp7" event={"ID":"dfb5c54b-81e0-4f3a-92de-ea544696ee4b","Type":"ContainerStarted","Data":"11d64ff6a0406537ead60f11d0d81df5280494f79d2cf76de460ae9896349099"} Nov 04 07:15:21.040884 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.040285 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-9k9rx_ecfd331a-08c4-43ac-a58c-9f43935d06ed/console-operator/0.log" Nov 04 07:15:21.040884 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.040318 2576 generic.go:356] "Generic (PLEG): container finished" podID="ecfd331a-08c4-43ac-a58c-9f43935d06ed" containerID="dc84626df26eaa2b820eb3600dbf300b6e99a0723a28fbc64114b94ae462fbe9" exitCode=255 Nov 04 07:15:21.040884 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.040586 2576 scope.go:122] "RemoveContainer" containerID="dc84626df26eaa2b820eb3600dbf300b6e99a0723a28fbc64114b94ae462fbe9" Nov 04 07:15:21.040884 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.040813 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" event={"ID":"ecfd331a-08c4-43ac-a58c-9f43935d06ed","Type":"ContainerDied","Data":"dc84626df26eaa2b820eb3600dbf300b6e99a0723a28fbc64114b94ae462fbe9"} Nov 04 07:15:21.047889 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.046754 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw" event={"ID":"9f9af642-8ada-4711-b1d1-e6b086e6b16c","Type":"ContainerStarted","Data":"a840f298ffcbaa0aec7209ed1d70fbdd7f983ce01a8d873e0340ac36d867859b"} Nov 04 07:15:21.055339 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.054371 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e87e5256-fef7-4160-b3d9-c96d0c01641a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:21.055339 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.054431 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e87e5256-fef7-4160-b3d9-c96d0c01641a-data-volume\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:21.055339 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.054458 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7hld\" (UniqueName: \"kubernetes.io/projected/e87e5256-fef7-4160-b3d9-c96d0c01641a-kube-api-access-n7hld\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:21.055339 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.054503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e87e5256-fef7-4160-b3d9-c96d0c01641a-crio-socket\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:21.055339 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.054610 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:21.056222 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.055799 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-p5lnr" event={"ID":"a1971526-e34c-4dd8-9c6c-b6d9d13356c1","Type":"ContainerStarted","Data":"276304327ed1679129ff70fd45e5ae32c679fa74617b15d0a3289541c00ce05b"} Nov 04 07:15:21.058265 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.058242 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hh854" event={"ID":"5977e1b4-8c3a-42b7-8e3a-e152fd907bd4","Type":"ContainerStarted","Data":"61a548d5257b781486bd4294d64173b5de90fa16d4535c5f3b3c5aa99ce51fbe"} Nov 04 07:15:21.108475 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.108330 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rtcv5" podStartSLOduration=1.827173648 podStartE2EDuration="7.10831276s" totalImagesPullingTime="5.281139112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:15:21.061349789 +0000 UTC m=+36.833804425" watchObservedRunningTime="2026-11-04 07:15:21.10831276 +0000 UTC m=+36.880767394" Nov 04 07:15:21.138370 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.137441 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-p5lnr" podStartSLOduration=378.822820266 podStartE2EDuration="6m24.137421604s" totalImagesPullingTime="5.314601338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:08:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:15:21.107413337 +0000 UTC m=+36.879867973" watchObservedRunningTime="2026-11-04 07:15:21.137421604 +0000 UTC m=+36.909876240" Nov 04 07:15:21.138370 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.137757 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-9slp7" podStartSLOduration=373.181004216 podStartE2EDuration="6m19.137745231s" totalImagesPullingTime="5.956741015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:15:21.13364107 +0000 UTC m=+36.906095704" watchObservedRunningTime="2026-11-04 07:15:21.137745231 +0000 UTC m=+36.910199870" Nov 04 07:15:21.158159 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.156263 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:21.158159 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.156311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/8949591f-9c25-4e76-a673-67eb381ea2e0-archives-path\") pod \"periodic-gathering-twnww-hrp7j\" (UID: \"8949591f-9c25-4e76-a673-67eb381ea2e0\") " pod="openshift-insights/periodic-gathering-twnww-hrp7j" Nov 04 07:15:21.158159 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.156332 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8949591f-9c25-4e76-a673-67eb381ea2e0-trusted-ca-bundle\") pod \"periodic-gathering-twnww-hrp7j\" (UID: \"8949591f-9c25-4e76-a673-67eb381ea2e0\") " pod="openshift-insights/periodic-gathering-twnww-hrp7j" Nov 04 07:15:21.158159 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.156375 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmgtx\" (UniqueName: \"kubernetes.io/projected/8949591f-9c25-4e76-a673-67eb381ea2e0-kube-api-access-hmgtx\") pod \"periodic-gathering-twnww-hrp7j\" (UID: \"8949591f-9c25-4e76-a673-67eb381ea2e0\") " pod="openshift-insights/periodic-gathering-twnww-hrp7j" Nov 04 07:15:21.158159 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.156415 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e87e5256-fef7-4160-b3d9-c96d0c01641a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:21.158159 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.156471 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e87e5256-fef7-4160-b3d9-c96d0c01641a-data-volume\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:21.158159 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.156488 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7hld\" (UniqueName: \"kubernetes.io/projected/e87e5256-fef7-4160-b3d9-c96d0c01641a-kube-api-access-n7hld\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:21.158159 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.156504 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8949591f-9c25-4e76-a673-67eb381ea2e0-service-ca-bundle\") pod \"periodic-gathering-twnww-hrp7j\" (UID: \"8949591f-9c25-4e76-a673-67eb381ea2e0\") " pod="openshift-insights/periodic-gathering-twnww-hrp7j" Nov 04 07:15:21.158159 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.156534 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e87e5256-fef7-4160-b3d9-c96d0c01641a-crio-socket\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:21.158159 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.157577 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 07:15:21.158159 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.157643 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls podName:e87e5256-fef7-4160-b3d9-c96d0c01641a nodeName:}" failed. No retries permitted until 2026-11-04 07:15:21.657624868 +0000 UTC m=+37.430079496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nx4xj" (UID: "e87e5256-fef7-4160-b3d9-c96d0c01641a") : secret "insights-runtime-extractor-tls" not found Nov 04 07:15:21.158159 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.157709 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e87e5256-fef7-4160-b3d9-c96d0c01641a-crio-socket\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:21.158159 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.157823 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e87e5256-fef7-4160-b3d9-c96d0c01641a-data-volume\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:21.158159 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.157845 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 04 07:15:21.158159 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.157918 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e87e5256-fef7-4160-b3d9-c96d0c01641a-kube-rbac-proxy-cm podName:e87e5256-fef7-4160-b3d9-c96d0c01641a nodeName:}" failed. No retries permitted until 2026-11-04 07:15:21.65790371 +0000 UTC m=+37.430358338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e87e5256-fef7-4160-b3d9-c96d0c01641a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nx4xj" (UID: "e87e5256-fef7-4160-b3d9-c96d0c01641a") : configmap "kube-rbac-proxy" not found Nov 04 07:15:21.176613 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.175596 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7hld\" (UniqueName: \"kubernetes.io/projected/e87e5256-fef7-4160-b3d9-c96d0c01641a-kube-api-access-n7hld\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:21.188814 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.188767 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw" podStartSLOduration=378.882738348 podStartE2EDuration="6m24.188752152s" totalImagesPullingTime="5.306013804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:08:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:15:21.164281724 +0000 UTC m=+36.936736364" watchObservedRunningTime="2026-11-04 07:15:21.188752152 +0000 UTC m=+36.961206788" Nov 04 07:15:21.209980 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.209758 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-q46x8"] Nov 04 07:15:21.227239 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.227009 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-q46x8"] Nov 04 07:15:21.227239 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.227093 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-q46x8" Nov 04 07:15:21.231457 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.231436 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mslv7\"" Nov 04 07:15:21.231855 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.231838 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Nov 04 07:15:21.231944 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.231914 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Nov 04 07:15:21.231999 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.231972 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Nov 04 07:15:21.232048 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.232013 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Nov 04 07:15:21.257882 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.257854 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/042264b0-c105-41fa-89a5-fc386cb90f15-signing-cabundle\") pod \"service-ca-5fffc97bdf-q46x8\" (UID: \"042264b0-c105-41fa-89a5-fc386cb90f15\") " pod="openshift-service-ca/service-ca-5fffc97bdf-q46x8" Nov 04 07:15:21.257982 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.257955 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/8949591f-9c25-4e76-a673-67eb381ea2e0-archives-path\") pod \"periodic-gathering-twnww-hrp7j\" (UID: \"8949591f-9c25-4e76-a673-67eb381ea2e0\") " pod="openshift-insights/periodic-gathering-twnww-hrp7j" Nov 04 07:15:21.258038 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.257992 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8949591f-9c25-4e76-a673-67eb381ea2e0-trusted-ca-bundle\") pod \"periodic-gathering-twnww-hrp7j\" (UID: \"8949591f-9c25-4e76-a673-67eb381ea2e0\") " pod="openshift-insights/periodic-gathering-twnww-hrp7j" Nov 04 07:15:21.258096 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.258038 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmgtx\" (UniqueName: \"kubernetes.io/projected/8949591f-9c25-4e76-a673-67eb381ea2e0-kube-api-access-hmgtx\") pod \"periodic-gathering-twnww-hrp7j\" (UID: \"8949591f-9c25-4e76-a673-67eb381ea2e0\") " pod="openshift-insights/periodic-gathering-twnww-hrp7j" Nov 04 07:15:21.258188 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.258172 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8949591f-9c25-4e76-a673-67eb381ea2e0-service-ca-bundle\") pod \"periodic-gathering-twnww-hrp7j\" (UID: \"8949591f-9c25-4e76-a673-67eb381ea2e0\") " pod="openshift-insights/periodic-gathering-twnww-hrp7j" Nov 04 07:15:21.258282 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.258267 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw5d7\" (UniqueName: \"kubernetes.io/projected/042264b0-c105-41fa-89a5-fc386cb90f15-kube-api-access-fw5d7\") pod \"service-ca-5fffc97bdf-q46x8\" (UID: \"042264b0-c105-41fa-89a5-fc386cb90f15\") " pod="openshift-service-ca/service-ca-5fffc97bdf-q46x8" Nov 04 07:15:21.258338 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.258324 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/042264b0-c105-41fa-89a5-fc386cb90f15-signing-key\") pod \"service-ca-5fffc97bdf-q46x8\" (UID: \"042264b0-c105-41fa-89a5-fc386cb90f15\") " pod="openshift-service-ca/service-ca-5fffc97bdf-q46x8" Nov 04 07:15:21.258768 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.258749 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/8949591f-9c25-4e76-a673-67eb381ea2e0-archives-path\") pod \"periodic-gathering-twnww-hrp7j\" (UID: \"8949591f-9c25-4e76-a673-67eb381ea2e0\") " pod="openshift-insights/periodic-gathering-twnww-hrp7j" Nov 04 07:15:21.259640 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.259614 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8949591f-9c25-4e76-a673-67eb381ea2e0-service-ca-bundle\") pod \"periodic-gathering-twnww-hrp7j\" (UID: \"8949591f-9c25-4e76-a673-67eb381ea2e0\") " pod="openshift-insights/periodic-gathering-twnww-hrp7j" Nov 04 07:15:21.260047 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.259992 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8949591f-9c25-4e76-a673-67eb381ea2e0-trusted-ca-bundle\") pod \"periodic-gathering-twnww-hrp7j\" (UID: \"8949591f-9c25-4e76-a673-67eb381ea2e0\") " pod="openshift-insights/periodic-gathering-twnww-hrp7j" Nov 04 07:15:21.287812 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.287767 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmgtx\" (UniqueName: \"kubernetes.io/projected/8949591f-9c25-4e76-a673-67eb381ea2e0-kube-api-access-hmgtx\") pod \"periodic-gathering-twnww-hrp7j\" (UID: \"8949591f-9c25-4e76-a673-67eb381ea2e0\") " pod="openshift-insights/periodic-gathering-twnww-hrp7j" Nov 04 07:15:21.325325 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.325300 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-twnww-hrp7j" Nov 04 07:15:21.358733 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.358700 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw5d7\" (UniqueName: \"kubernetes.io/projected/042264b0-c105-41fa-89a5-fc386cb90f15-kube-api-access-fw5d7\") pod \"service-ca-5fffc97bdf-q46x8\" (UID: \"042264b0-c105-41fa-89a5-fc386cb90f15\") " pod="openshift-service-ca/service-ca-5fffc97bdf-q46x8" Nov 04 07:15:21.358879 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.358759 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/042264b0-c105-41fa-89a5-fc386cb90f15-signing-key\") pod \"service-ca-5fffc97bdf-q46x8\" (UID: \"042264b0-c105-41fa-89a5-fc386cb90f15\") " pod="openshift-service-ca/service-ca-5fffc97bdf-q46x8" Nov 04 07:15:21.358879 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.358787 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/042264b0-c105-41fa-89a5-fc386cb90f15-signing-cabundle\") pod \"service-ca-5fffc97bdf-q46x8\" (UID: \"042264b0-c105-41fa-89a5-fc386cb90f15\") " pod="openshift-service-ca/service-ca-5fffc97bdf-q46x8" Nov 04 07:15:21.359902 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.359398 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/042264b0-c105-41fa-89a5-fc386cb90f15-signing-cabundle\") pod \"service-ca-5fffc97bdf-q46x8\" (UID: \"042264b0-c105-41fa-89a5-fc386cb90f15\") " pod="openshift-service-ca/service-ca-5fffc97bdf-q46x8" Nov 04 07:15:21.369369 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.369311 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/042264b0-c105-41fa-89a5-fc386cb90f15-signing-key\") pod \"service-ca-5fffc97bdf-q46x8\" (UID: \"042264b0-c105-41fa-89a5-fc386cb90f15\") " pod="openshift-service-ca/service-ca-5fffc97bdf-q46x8" Nov 04 07:15:21.372113 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.372071 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw5d7\" (UniqueName: \"kubernetes.io/projected/042264b0-c105-41fa-89a5-fc386cb90f15-kube-api-access-fw5d7\") pod \"service-ca-5fffc97bdf-q46x8\" (UID: \"042264b0-c105-41fa-89a5-fc386cb90f15\") " pod="openshift-service-ca/service-ca-5fffc97bdf-q46x8" Nov 04 07:15:21.562352 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.562314 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-q46x8" Nov 04 07:15:21.635339 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.635278 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-twnww-hrp7j"] Nov 04 07:15:21.649004 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:15:21.648964 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8949591f_9c25_4e76_a673_67eb381ea2e0.slice/crio-454bb0b6dc7eb00960bf4110c14de7dfae55c00d2d3f22abe5a84e5787be7156 WatchSource:0}: Error finding container 454bb0b6dc7eb00960bf4110c14de7dfae55c00d2d3f22abe5a84e5787be7156: Status 404 returned error can't find the container with id 454bb0b6dc7eb00960bf4110c14de7dfae55c00d2d3f22abe5a84e5787be7156 Nov 04 07:15:21.663322 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.662430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:21.663322 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.662517 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e87e5256-fef7-4160-b3d9-c96d0c01641a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:21.663322 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.662607 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 04 07:15:21.663322 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.662659 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e87e5256-fef7-4160-b3d9-c96d0c01641a-kube-rbac-proxy-cm podName:e87e5256-fef7-4160-b3d9-c96d0c01641a nodeName:}" failed. No retries permitted until 2026-11-04 07:15:22.662641702 +0000 UTC m=+38.435096330 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e87e5256-fef7-4160-b3d9-c96d0c01641a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nx4xj" (UID: "e87e5256-fef7-4160-b3d9-c96d0c01641a") : configmap "kube-rbac-proxy" not found Nov 04 07:15:21.663322 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.663041 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 07:15:21.663322 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.663089 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls podName:e87e5256-fef7-4160-b3d9-c96d0c01641a nodeName:}" failed. No retries permitted until 2026-11-04 07:15:22.663074821 +0000 UTC m=+38.435529449 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nx4xj" (UID: "e87e5256-fef7-4160-b3d9-c96d0c01641a") : secret "insights-runtime-extractor-tls" not found Nov 04 07:15:21.863874 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.863786 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-tls\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:21.863874 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.863853 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:21.864068 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.863879 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f12932cd-facc-4cf2-bd45-d359ae6d6012-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-hb4ng\" (UID: \"f12932cd-facc-4cf2-bd45-d359ae6d6012\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng" Nov 04 07:15:21.864068 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.863921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-metrics-certs\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:21.864068 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.864051 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 07:15:21.864262 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.864100 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-metrics-certs podName:c96c91ba-0da0-4c2c-a881-e3ffffe63714 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:29.864087417 +0000 UTC m=+45.636542030 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-metrics-certs") pod "router-default-6d87c68c59-n7zhf" (UID: "c96c91ba-0da0-4c2c-a881-e3ffffe63714") : secret "router-metrics-certs-default" not found Nov 04 07:15:21.864542 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.864431 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 07:15:21.864542 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.864456 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle podName:c96c91ba-0da0-4c2c-a881-e3ffffe63714 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:29.864438096 +0000 UTC m=+45.636892709 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle") pod "router-default-6d87c68c59-n7zhf" (UID: "c96c91ba-0da0-4c2c-a881-e3ffffe63714") : configmap references non-existent config key: service-ca.crt Nov 04 07:15:21.864542 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.864491 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f12932cd-facc-4cf2-bd45-d359ae6d6012-cluster-monitoring-operator-tls podName:f12932cd-facc-4cf2-bd45-d359ae6d6012 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:29.864480352 +0000 UTC m=+45.636934968 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f12932cd-facc-4cf2-bd45-d359ae6d6012-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-hb4ng" (UID: "f12932cd-facc-4cf2-bd45-d359ae6d6012") : secret "cluster-monitoring-operator-tls" not found Nov 04 07:15:21.864542 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.864502 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 07:15:21.864542 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.864511 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f5799855-6xlbc: secret "image-registry-tls" not found Nov 04 07:15:21.864542 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.864544 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-tls podName:fb5b977d-e13b-4499-8f7d-57b96f1b62bb nodeName:}" failed. No retries permitted until 2026-11-04 07:15:29.864531032 +0000 UTC m=+45.636985645 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-tls") pod "image-registry-85f5799855-6xlbc" (UID: "fb5b977d-e13b-4499-8f7d-57b96f1b62bb") : secret "image-registry-tls" not found Nov 04 07:15:21.889244 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.889172 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-q46x8"] Nov 04 07:15:21.892999 ip-10-0-130-91 kubenswrapper[2576]: W1104 07:15:21.892968 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod042264b0_c105_41fa_89a5_fc386cb90f15.slice/crio-5d3e5946e4f744fc1ec695e229f3c583b19113bfd08abf9ed3944ff5bb723583 WatchSource:0}: Error finding container 5d3e5946e4f744fc1ec695e229f3c583b19113bfd08abf9ed3944ff5bb723583: Status 404 returned error can't find the container with id 5d3e5946e4f744fc1ec695e229f3c583b19113bfd08abf9ed3944ff5bb723583 Nov 04 07:15:21.965555 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.964933 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8deda5b1-d839-4a8b-b902-8e341ffe5340-metrics-tls\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:21.965555 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.965223 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 07:15:21.965555 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.965290 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8deda5b1-d839-4a8b-b902-8e341ffe5340-metrics-tls podName:8deda5b1-d839-4a8b-b902-8e341ffe5340 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:29.96527181 +0000 UTC m=+45.737726437 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8deda5b1-d839-4a8b-b902-8e341ffe5340-metrics-tls") pod "dns-default-6x2rp" (UID: "8deda5b1-d839-4a8b-b902-8e341ffe5340") : secret "dns-default-metrics-tls" not found Nov 04 07:15:21.966097 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.965967 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-vlsf6\" (UID: \"4e036a5c-ee3f-4b8f-a173-b3b6c052bca7\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-vlsf6" Nov 04 07:15:21.966326 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.966308 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 07:15:21.966388 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.966370 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-networking-console-plugin-cert podName:4e036a5c-ee3f-4b8f-a173-b3b6c052bca7 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:29.966353829 +0000 UTC m=+45.738808459 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-vlsf6" (UID: "4e036a5c-ee3f-4b8f-a173-b3b6c052bca7") : secret "networking-console-plugin-cert" not found Nov 04 07:15:21.966457 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.966424 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jrqx8\" (UID: \"3ea0ef4d-2fdb-4090-965f-3db3237a4c69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" Nov 04 07:15:21.966540 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:21.966499 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-tls\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:21.966681 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.966664 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 07:15:21.966943 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.966925 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 07:15:21.966988 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.966947 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67f4948c94-mmrkw: secret "image-registry-tls" not found Nov 04 07:15:21.967022 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.966794 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-tls podName:3ea0ef4d-2fdb-4090-965f-3db3237a4c69 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:29.966779709 +0000 UTC m=+45.739234324 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-jrqx8" (UID: "3ea0ef4d-2fdb-4090-965f-3db3237a4c69") : secret "samples-operator-tls" not found Nov 04 07:15:21.967022 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:21.967014 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-tls podName:aaff7a50-eb36-414b-a45e-5a0a56e3a8eb nodeName:}" failed. No retries permitted until 2026-11-04 07:15:29.967001035 +0000 UTC m=+45.739455651 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-tls") pod "image-registry-67f4948c94-mmrkw" (UID: "aaff7a50-eb36-414b-a45e-5a0a56e3a8eb") : secret "image-registry-tls" not found Nov 04 07:15:22.065686 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:22.065651 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-q46x8" event={"ID":"042264b0-c105-41fa-89a5-fc386cb90f15","Type":"ContainerStarted","Data":"b15340de652a6702f037b09f29b538e9207c135f8eb1dc116474083129851646"} Nov 04 07:15:22.065859 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:22.065700 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-q46x8" event={"ID":"042264b0-c105-41fa-89a5-fc386cb90f15","Type":"ContainerStarted","Data":"5d3e5946e4f744fc1ec695e229f3c583b19113bfd08abf9ed3944ff5bb723583"} Nov 04 07:15:22.075951 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:22.075392 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-twnww-hrp7j" event={"ID":"8949591f-9c25-4e76-a673-67eb381ea2e0","Type":"ContainerStarted","Data":"7be7c9c850a08d03d3263c6c8fe1b28b69d9706905a0c035e2856117d7b3fbf1"} Nov 04 07:15:22.075951 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:22.075440 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-twnww-hrp7j" event={"ID":"8949591f-9c25-4e76-a673-67eb381ea2e0","Type":"ContainerStarted","Data":"454bb0b6dc7eb00960bf4110c14de7dfae55c00d2d3f22abe5a84e5787be7156"} Nov 04 07:15:22.078618 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:22.078526 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-9k9rx_ecfd331a-08c4-43ac-a58c-9f43935d06ed/console-operator/1.log" Nov 04 07:15:22.081646 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:22.079194 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-9k9rx_ecfd331a-08c4-43ac-a58c-9f43935d06ed/console-operator/0.log" Nov 04 07:15:22.081646 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:22.079228 2576 generic.go:356] "Generic (PLEG): container finished" podID="ecfd331a-08c4-43ac-a58c-9f43935d06ed" containerID="c6ea87867881bbc8815dc1773196ebe237577567ccdee9931a6ddaa171204b45" exitCode=255 Nov 04 07:15:22.081646 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:22.079928 2576 scope.go:122] "RemoveContainer" containerID="c6ea87867881bbc8815dc1773196ebe237577567ccdee9931a6ddaa171204b45" Nov 04 07:15:22.081646 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:22.080095 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-9k9rx_openshift-console-operator(ecfd331a-08c4-43ac-a58c-9f43935d06ed)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" podUID="ecfd331a-08c4-43ac-a58c-9f43935d06ed" Nov 04 07:15:22.081646 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:22.080302 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" event={"ID":"ecfd331a-08c4-43ac-a58c-9f43935d06ed","Type":"ContainerDied","Data":"c6ea87867881bbc8815dc1773196ebe237577567ccdee9931a6ddaa171204b45"} Nov 04 07:15:22.081646 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:22.080345 2576 scope.go:122] "RemoveContainer" containerID="dc84626df26eaa2b820eb3600dbf300b6e99a0723a28fbc64114b94ae462fbe9" Nov 04 07:15:22.123850 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:22.123642 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-q46x8" podStartSLOduration=1.123629491 podStartE2EDuration="1.123629491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:15:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:15:22.096792458 +0000 UTC m=+37.869247094" watchObservedRunningTime="2026-11-04 07:15:22.123629491 +0000 UTC m=+37.896084128" Nov 04 07:15:22.142171 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:22.142112 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-twnww-hrp7j" podStartSLOduration=2.142099598 podStartE2EDuration="2.142099598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:15:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:15:22.141167213 +0000 UTC m=+37.913621850" watchObservedRunningTime="2026-11-04 07:15:22.142099598 +0000 UTC m=+37.914554232" Nov 04 07:15:22.674634 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:22.674296 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:22.674634 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:22.674456 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e87e5256-fef7-4160-b3d9-c96d0c01641a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:22.674634 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:22.674491 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 07:15:22.674634 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:22.674552 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls podName:e87e5256-fef7-4160-b3d9-c96d0c01641a nodeName:}" failed. No retries permitted until 2026-11-04 07:15:24.674534343 +0000 UTC m=+40.446988978 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nx4xj" (UID: "e87e5256-fef7-4160-b3d9-c96d0c01641a") : secret "insights-runtime-extractor-tls" not found Nov 04 07:15:22.674634 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:22.674577 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 04 07:15:22.674634 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:22.674609 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e87e5256-fef7-4160-b3d9-c96d0c01641a-kube-rbac-proxy-cm podName:e87e5256-fef7-4160-b3d9-c96d0c01641a nodeName:}" failed. No retries permitted until 2026-11-04 07:15:24.674600245 +0000 UTC m=+40.447054875 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e87e5256-fef7-4160-b3d9-c96d0c01641a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nx4xj" (UID: "e87e5256-fef7-4160-b3d9-c96d0c01641a") : configmap "kube-rbac-proxy" not found Nov 04 07:15:23.092060 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:23.091338 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hh854" event={"ID":"5977e1b4-8c3a-42b7-8e3a-e152fd907bd4","Type":"ContainerStarted","Data":"a65e69743867299294ab50fe94addb613a44fe69fce198256f8cee2ae60aff91"} Nov 04 07:15:23.093703 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:23.093677 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-tlcjg" event={"ID":"20da56ab-0718-406e-80c4-d8fb20ac7049","Type":"ContainerStarted","Data":"36896adc96ed0e76ae622c0172922bb3a7e04d4c4521d9606116648f56893834"} Nov 04 07:15:23.096737 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:23.096716 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-9k9rx_ecfd331a-08c4-43ac-a58c-9f43935d06ed/console-operator/1.log" Nov 04 07:15:23.097376 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:23.097361 2576 scope.go:122] "RemoveContainer" containerID="c6ea87867881bbc8815dc1773196ebe237577567ccdee9931a6ddaa171204b45" Nov 04 07:15:23.097548 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:23.097523 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-9k9rx_openshift-console-operator(ecfd331a-08c4-43ac-a58c-9f43935d06ed)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" podUID="ecfd331a-08c4-43ac-a58c-9f43935d06ed" Nov 04 07:15:23.128226 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:23.128168 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hh854" podStartSLOduration=1.6901261330000001 podStartE2EDuration="4.128151513s" totalImagesPullingTime="2.43802538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:15:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:15:23.126446993 +0000 UTC m=+38.898901625" watchObservedRunningTime="2026-11-04 07:15:23.128151513 +0000 UTC m=+38.900606142" Nov 04 07:15:23.169821 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:23.169775 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-tlcjg" podStartSLOduration=1.7268598370000001 podStartE2EDuration="4.169759596s" totalImagesPullingTime="2.442899759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:15:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:15:23.169342566 +0000 UTC m=+38.941797201" watchObservedRunningTime="2026-11-04 07:15:23.169759596 +0000 UTC m=+38.942214235" Nov 04 07:15:24.102607 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:24.102568 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rq9pn" event={"ID":"0acaaee7-9bc3-499b-ba3f-50cc5d7498fd","Type":"ContainerStarted","Data":"0b466a0b11a055b9cadb25eb0ce539cada8bd882059916269f223a13aa40d255"} Nov 04 07:15:24.103063 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:24.102638 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:15:24.122946 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:24.122897 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rq9pn" podStartSLOduration=35.842808601 podStartE2EDuration="40.122883447s" totalImagesPullingTime="4.280074846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:15:24.120299168 +0000 UTC m=+39.892753806" watchObservedRunningTime="2026-11-04 07:15:24.122883447 +0000 UTC m=+39.895338084" Nov 04 07:15:24.493122 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:24.493088 2576 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:24.493317 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:24.493171 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:24.493558 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:24.493539 2576 scope.go:122] "RemoveContainer" containerID="c6ea87867881bbc8815dc1773196ebe237577567ccdee9931a6ddaa171204b45" Nov 04 07:15:24.493771 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:24.493738 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-9k9rx_openshift-console-operator(ecfd331a-08c4-43ac-a58c-9f43935d06ed)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" podUID="ecfd331a-08c4-43ac-a58c-9f43935d06ed" Nov 04 07:15:24.694781 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:24.694737 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:24.694955 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:24.694888 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 07:15:24.695006 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:24.694954 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e87e5256-fef7-4160-b3d9-c96d0c01641a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:24.695006 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:24.694964 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls podName:e87e5256-fef7-4160-b3d9-c96d0c01641a nodeName:}" failed. No retries permitted until 2026-11-04 07:15:28.694943189 +0000 UTC m=+44.467398020 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nx4xj" (UID: "e87e5256-fef7-4160-b3d9-c96d0c01641a") : secret "insights-runtime-extractor-tls" not found Nov 04 07:15:24.695109 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:24.695018 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 04 07:15:24.695109 ip-10-0-130-91 kubenswrapper[2576]: E1104 07:15:24.695068 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e87e5256-fef7-4160-b3d9-c96d0c01641a-kube-rbac-proxy-cm podName:e87e5256-fef7-4160-b3d9-c96d0c01641a nodeName:}" failed. No retries permitted until 2026-11-04 07:15:28.69505523 +0000 UTC m=+44.467509858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e87e5256-fef7-4160-b3d9-c96d0c01641a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nx4xj" (UID: "e87e5256-fef7-4160-b3d9-c96d0c01641a") : configmap "kube-rbac-proxy" not found Nov 04 07:15:25.722219 ip-10-0-130-91 kubenswrapper[2576]: I1104 07:15:25.722198 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4qdls_473ae29e-1292-4044-988e-293d9ae8cfe3/dns-node-resolver/0.log" Nov 04 07:15:25.943898 ip-10-0-130-91 systemd[1]: Stopping Kubernetes Kubelet... Nov 04 07:15:25.957508 ip-10-0-130-91 systemd[1]: kubelet.service: Deactivated successfully. Nov 04 07:15:25.957670 ip-10-0-130-91 systemd[1]: Stopped Kubernetes Kubelet. Nov 04 07:15:25.957716 ip-10-0-130-91 systemd[1]: kubelet.service: Consumed 3.045s CPU time. Nov 04 07:15:25.968709 ip-10-0-130-91 systemd[1]: Starting Kubernetes Kubelet... Nov 04 07:15:26.046463 ip-10-0-130-91 kubenswrapper[5030]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 07:15:26.046463 ip-10-0-130-91 kubenswrapper[5030]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 04 07:15:26.046463 ip-10-0-130-91 kubenswrapper[5030]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 07:15:26.046463 ip-10-0-130-91 kubenswrapper[5030]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 07:15:26.048486 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048412 5030 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 07:15:26.048486 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048484 5030 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 07:15:26.048486 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048488 5030 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 07:15:26.048486 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048491 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 07:15:26.048685 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048494 5030 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 07:15:26.048685 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048497 5030 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 07:15:26.048685 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048501 5030 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 07:15:26.048685 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048503 5030 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 07:15:26.048685 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048506 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 07:15:26.048685 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048509 5030 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 07:15:26.048685 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048512 5030 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 07:15:26.048685 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048515 5030 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 07:15:26.048685 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048517 5030 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 07:15:26.048685 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048520 5030 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 07:15:26.048685 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048523 5030 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 07:15:26.048685 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048525 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 07:15:26.048685 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048528 5030 feature_gate.go:386] unrecognized feature gate: Example Nov 04 07:15:26.048685 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048531 5030 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 07:15:26.048685 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048534 5030 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 07:15:26.048685 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048540 5030 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 07:15:26.048685 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048543 5030 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 07:15:26.048685 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048545 5030 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 07:15:26.048685 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048548 5030 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 07:15:26.048685 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048551 5030 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 07:15:26.049266 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048553 5030 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 07:15:26.049266 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048556 5030 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 07:15:26.049266 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048559 5030 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 07:15:26.049266 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048562 5030 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 07:15:26.049266 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048565 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 07:15:26.049266 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048567 5030 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 07:15:26.049266 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048570 5030 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 07:15:26.049266 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048572 5030 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 07:15:26.049266 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048575 5030 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 07:15:26.049266 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048578 5030 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 07:15:26.049266 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048580 5030 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 07:15:26.049266 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048583 5030 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 07:15:26.049266 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048586 5030 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 07:15:26.049266 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048589 5030 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 07:15:26.049266 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048592 5030 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 07:15:26.049266 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048597 5030 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 07:15:26.049266 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048601 5030 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 07:15:26.049266 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048604 5030 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 07:15:26.049266 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048607 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 07:15:26.049815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048610 5030 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 07:15:26.049815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048612 5030 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 07:15:26.049815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048615 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 07:15:26.049815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048617 5030 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 07:15:26.049815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048620 5030 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 07:15:26.049815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048623 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 07:15:26.049815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048625 5030 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 07:15:26.049815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048628 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 07:15:26.049815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048636 5030 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 07:15:26.049815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048639 5030 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 07:15:26.049815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048642 5030 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 07:15:26.049815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048645 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 07:15:26.049815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048647 5030 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 07:15:26.049815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048650 5030 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 07:15:26.049815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048653 5030 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 07:15:26.049815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048655 5030 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 07:15:26.049815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048658 5030 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 07:15:26.049815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048660 5030 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 07:15:26.049815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048662 5030 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 07:15:26.049815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048666 5030 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 07:15:26.050367 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048669 5030 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 07:15:26.050367 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048671 5030 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 07:15:26.050367 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048674 5030 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 07:15:26.050367 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048677 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 07:15:26.050367 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048680 5030 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 07:15:26.050367 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048683 5030 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 07:15:26.050367 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048686 5030 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 07:15:26.050367 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048689 5030 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 07:15:26.050367 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048691 5030 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 07:15:26.050367 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048694 5030 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 07:15:26.050367 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048697 5030 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 07:15:26.050367 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048699 5030 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 07:15:26.050367 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048702 5030 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 07:15:26.050367 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048705 5030 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 07:15:26.050367 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048707 5030 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 07:15:26.050367 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048710 5030 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 07:15:26.050367 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048712 5030 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 07:15:26.050367 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048715 5030 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 07:15:26.050367 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048717 5030 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 07:15:26.050367 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048720 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 07:15:26.050928 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048724 5030 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 07:15:26.050928 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048728 5030 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 07:15:26.050928 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048732 5030 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 07:15:26.050928 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048735 5030 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 07:15:26.050928 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048738 5030 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 07:15:26.050928 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048741 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 07:15:26.050928 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048743 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 07:15:26.050928 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048746 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 07:15:26.050928 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048749 5030 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 07:15:26.050928 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048752 5030 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 07:15:26.050928 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048754 5030 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 07:15:26.050928 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048757 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 07:15:26.050928 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048759 5030 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 07:15:26.050928 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048762 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 07:15:26.050928 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048765 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 07:15:26.050928 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048768 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 07:15:26.050928 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048770 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 07:15:26.050928 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048774 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 07:15:26.050928 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048777 5030 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 07:15:26.051470 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048780 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 07:15:26.051470 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048782 5030 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 07:15:26.051470 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048785 5030 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 07:15:26.051470 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.048787 5030 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 07:15:26.051470 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049648 5030 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 07:15:26.051470 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049656 5030 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 07:15:26.051470 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049660 5030 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 07:15:26.051470 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049663 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 07:15:26.051470 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049668 5030 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 07:15:26.051470 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049672 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 07:15:26.051470 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049675 5030 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 07:15:26.051470 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049678 5030 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 07:15:26.051470 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049681 5030 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 07:15:26.051470 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049684 5030 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 07:15:26.051470 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049687 5030 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 07:15:26.051470 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049695 5030 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 07:15:26.051470 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049698 5030 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 07:15:26.051470 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049700 5030 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 07:15:26.051470 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049703 5030 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 07:15:26.052152 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049706 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 07:15:26.052152 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049708 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 07:15:26.052152 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049711 5030 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 07:15:26.052152 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049714 5030 feature_gate.go:386] unrecognized feature gate: Example Nov 04 07:15:26.052152 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049716 5030 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 07:15:26.052152 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049719 5030 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 07:15:26.052152 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049721 5030 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 07:15:26.052152 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049724 5030 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 07:15:26.052152 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049727 5030 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 07:15:26.052152 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049730 5030 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 07:15:26.052152 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049732 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 07:15:26.052152 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049735 5030 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 07:15:26.052152 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049738 5030 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 07:15:26.052152 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049740 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 07:15:26.052152 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049743 5030 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 07:15:26.052152 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049746 5030 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 07:15:26.052152 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049748 5030 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 07:15:26.052152 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049751 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 07:15:26.052152 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049753 5030 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 07:15:26.052152 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049756 5030 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 07:15:26.052882 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049758 5030 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 07:15:26.052882 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049761 5030 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 07:15:26.052882 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049763 5030 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 07:15:26.052882 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049766 5030 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 07:15:26.052882 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049769 5030 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 07:15:26.052882 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049772 5030 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 07:15:26.052882 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049774 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 07:15:26.052882 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049777 5030 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 07:15:26.052882 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049779 5030 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 07:15:26.052882 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049788 5030 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 07:15:26.052882 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049791 5030 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 07:15:26.052882 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049794 5030 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 07:15:26.052882 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049796 5030 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 07:15:26.052882 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049799 5030 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 07:15:26.052882 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049801 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 07:15:26.052882 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049804 5030 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 07:15:26.052882 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049807 5030 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 07:15:26.052882 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049810 5030 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 07:15:26.052882 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049812 5030 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 07:15:26.052882 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049815 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 07:15:26.053419 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049818 5030 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 07:15:26.053419 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049822 5030 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 07:15:26.053419 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049825 5030 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 07:15:26.053419 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049829 5030 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 07:15:26.053419 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049833 5030 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 07:15:26.053419 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049841 5030 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 07:15:26.053419 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049844 5030 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 07:15:26.053419 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049847 5030 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 07:15:26.053419 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049850 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 07:15:26.053419 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049852 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 07:15:26.053419 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049855 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 07:15:26.053419 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049857 5030 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 07:15:26.053419 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049860 5030 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 07:15:26.053419 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049863 5030 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 07:15:26.053419 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049865 5030 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 07:15:26.053419 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049868 5030 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 07:15:26.053419 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049870 5030 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 07:15:26.053419 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049873 5030 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 07:15:26.053419 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049875 5030 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 07:15:26.053870 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049878 5030 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 07:15:26.053870 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049880 5030 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 07:15:26.053870 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049883 5030 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 07:15:26.053870 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049891 5030 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 07:15:26.053870 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049894 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 07:15:26.053870 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049897 5030 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 07:15:26.053870 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049900 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 07:15:26.053870 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049903 5030 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 07:15:26.053870 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049905 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 07:15:26.053870 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049908 5030 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 07:15:26.053870 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049911 5030 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 07:15:26.053870 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049913 5030 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 07:15:26.053870 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049916 5030 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 07:15:26.053870 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049919 5030 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 07:15:26.053870 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049921 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 07:15:26.053870 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049924 5030 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 07:15:26.053870 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049926 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 07:15:26.053870 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049929 5030 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 07:15:26.053870 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049931 5030 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 07:15:26.054377 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049936 5030 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 07:15:26.054377 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049939 5030 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 07:15:26.054377 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049941 5030 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 07:15:26.054377 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049944 5030 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 07:15:26.054377 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049947 5030 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 07:15:26.054377 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049949 5030 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 07:15:26.054377 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049952 5030 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 07:15:26.054377 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049954 5030 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 07:15:26.054377 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049957 5030 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 07:15:26.054377 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049959 5030 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 07:15:26.054377 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049962 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 07:15:26.054377 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049964 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 07:15:26.054377 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.049967 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 07:15:26.054377 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050533 5030 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 07:15:26.054377 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050539 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 07:15:26.054377 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050542 5030 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 07:15:26.054377 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050551 5030 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 07:15:26.054377 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050554 5030 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 07:15:26.054377 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050556 5030 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 07:15:26.054377 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050559 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 07:15:26.054878 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050562 5030 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 07:15:26.054878 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050565 5030 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 07:15:26.054878 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050567 5030 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 07:15:26.054878 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050570 5030 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 07:15:26.054878 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050572 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 07:15:26.054878 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050575 5030 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 07:15:26.054878 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050578 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 07:15:26.054878 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050580 5030 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 07:15:26.054878 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050582 5030 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 07:15:26.054878 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050588 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 07:15:26.054878 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050590 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 07:15:26.054878 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050593 5030 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 07:15:26.054878 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050596 5030 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 07:15:26.054878 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050598 5030 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 07:15:26.054878 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050601 5030 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 07:15:26.054878 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050603 5030 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 07:15:26.054878 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050606 5030 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 07:15:26.054878 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050609 5030 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 07:15:26.054878 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050612 5030 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 07:15:26.054878 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050616 5030 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 07:15:26.055395 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050619 5030 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 07:15:26.055395 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050622 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 07:15:26.055395 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050625 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 07:15:26.055395 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050628 5030 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 07:15:26.055395 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050630 5030 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 07:15:26.055395 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050633 5030 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 07:15:26.055395 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050635 5030 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 07:15:26.055395 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050638 5030 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 07:15:26.055395 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050640 5030 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 07:15:26.055395 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050650 5030 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 07:15:26.055395 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050653 5030 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 07:15:26.055395 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050655 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 07:15:26.055395 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050658 5030 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 07:15:26.055395 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050660 5030 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 07:15:26.055395 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050663 5030 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 07:15:26.055395 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050666 5030 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 07:15:26.055395 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050668 5030 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 07:15:26.055395 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050671 5030 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 07:15:26.055395 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050673 5030 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 07:15:26.055395 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050676 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 07:15:26.056381 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050678 5030 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 07:15:26.056381 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050682 5030 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 07:15:26.056381 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050685 5030 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 07:15:26.056381 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050689 5030 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 07:15:26.056381 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050692 5030 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 07:15:26.056381 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050695 5030 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 07:15:26.056381 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050697 5030 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 07:15:26.056381 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050700 5030 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 07:15:26.056381 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050702 5030 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 07:15:26.056381 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050705 5030 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 07:15:26.056381 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050707 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 07:15:26.056381 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050710 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 07:15:26.056381 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050712 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 07:15:26.056381 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050715 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 07:15:26.056381 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050717 5030 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 07:15:26.056381 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050720 5030 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 07:15:26.056381 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050722 5030 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 07:15:26.056381 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050725 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 07:15:26.056381 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050728 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 07:15:26.057189 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050730 5030 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 07:15:26.057189 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050734 5030 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 07:15:26.057189 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050738 5030 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 07:15:26.057189 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050747 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 07:15:26.057189 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050750 5030 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 07:15:26.057189 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050753 5030 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 07:15:26.057189 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050756 5030 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 07:15:26.057189 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050759 5030 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 07:15:26.057189 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050762 5030 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 07:15:26.057189 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050764 5030 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 07:15:26.057189 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050767 5030 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 07:15:26.057189 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050769 5030 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 07:15:26.057189 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050772 5030 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 07:15:26.057189 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050775 5030 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 07:15:26.057189 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050778 5030 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 07:15:26.057189 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050781 5030 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 07:15:26.057189 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050785 5030 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 07:15:26.057189 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050787 5030 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 07:15:26.057189 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050790 5030 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 07:15:26.057999 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050793 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 07:15:26.057999 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050795 5030 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 07:15:26.057999 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050798 5030 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 07:15:26.057999 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050800 5030 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 07:15:26.057999 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050808 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 07:15:26.057999 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050811 5030 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 07:15:26.057999 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050815 5030 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 07:15:26.057999 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050817 5030 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 07:15:26.057999 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050820 5030 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 07:15:26.057999 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050822 5030 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 07:15:26.057999 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050825 5030 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 07:15:26.057999 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050829 5030 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 07:15:26.057999 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050832 5030 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 07:15:26.057999 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050836 5030 feature_gate.go:386] unrecognized feature gate: Example Nov 04 07:15:26.057999 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050840 5030 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 07:15:26.057999 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050844 5030 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 07:15:26.057999 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050847 5030 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 07:15:26.057999 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050857 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 07:15:26.057999 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050860 5030 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 07:15:26.057999 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050863 5030 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 07:15:26.058949 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.050865 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 07:15:26.058949 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.050956 5030 flags.go:64] FLAG: --address="0.0.0.0" Nov 04 07:15:26.058949 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.050963 5030 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 04 07:15:26.058949 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.050977 5030 flags.go:64] FLAG: --anonymous-auth="true" Nov 04 07:15:26.058949 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.050981 5030 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 04 07:15:26.058949 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.050986 5030 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 04 07:15:26.058949 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.050989 5030 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 04 07:15:26.058949 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.050995 5030 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 04 07:15:26.058949 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.050999 5030 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 04 07:15:26.058949 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051004 5030 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 04 07:15:26.058949 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051007 5030 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 04 07:15:26.058949 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051010 5030 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 04 07:15:26.058949 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051014 5030 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 04 07:15:26.058949 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051017 5030 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 04 07:15:26.058949 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051020 5030 flags.go:64] FLAG: --cgroup-root="" Nov 04 07:15:26.058949 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051022 5030 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 04 07:15:26.058949 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051026 5030 flags.go:64] FLAG: --client-ca-file="" Nov 04 07:15:26.058949 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051029 5030 flags.go:64] FLAG: --cloud-provider="external" Nov 04 07:15:26.058949 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051032 5030 flags.go:64] FLAG: --cluster-dns="[]" Nov 04 07:15:26.058949 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051039 5030 flags.go:64] FLAG: --cluster-domain="" Nov 04 07:15:26.058949 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051041 5030 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 04 07:15:26.058949 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051045 5030 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 04 07:15:26.058949 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051048 5030 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 04 07:15:26.058949 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051051 5030 flags.go:64] FLAG: --container-log-max-files="5" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051055 5030 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051058 5030 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051061 5030 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051065 5030 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051068 5030 flags.go:64] FLAG: --contention-profiling="false" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051071 5030 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051079 5030 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051083 5030 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051086 5030 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051090 5030 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051093 5030 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051096 5030 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051099 5030 flags.go:64] FLAG: --enable-load-reader="false" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051102 5030 flags.go:64] FLAG: --enable-server="true" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051105 5030 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051113 5030 flags.go:64] FLAG: --event-burst="100" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051116 5030 flags.go:64] FLAG: --event-qps="50" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051121 5030 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051124 5030 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051127 5030 flags.go:64] FLAG: --eviction-hard="" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051149 5030 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051152 5030 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051156 5030 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051159 5030 flags.go:64] FLAG: --eviction-soft="" Nov 04 07:15:26.060031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051162 5030 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 04 07:15:26.061124 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051165 5030 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 04 07:15:26.061124 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051168 5030 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 04 07:15:26.061124 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051171 5030 flags.go:64] FLAG: --experimental-mounter-path="" Nov 04 07:15:26.061124 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051174 5030 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 04 07:15:26.061124 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051177 5030 flags.go:64] FLAG: --fail-swap-on="true" Nov 04 07:15:26.061124 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051180 5030 flags.go:64] FLAG: --feature-gates="" Nov 04 07:15:26.061124 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051184 5030 flags.go:64] FLAG: --file-check-frequency="20s" Nov 04 07:15:26.061124 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051187 5030 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 04 07:15:26.061124 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051190 5030 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 04 07:15:26.061124 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051193 5030 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 04 07:15:26.061124 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051196 5030 flags.go:64] FLAG: --healthz-port="10248" Nov 04 07:15:26.061124 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051200 5030 flags.go:64] FLAG: --help="false" Nov 04 07:15:26.061124 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051203 5030 flags.go:64] FLAG: --hostname-override="ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:15:26.061124 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051206 5030 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 04 07:15:26.061124 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051216 5030 flags.go:64] FLAG: --http-check-frequency="20s" Nov 04 07:15:26.061124 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051220 5030 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 04 07:15:26.061124 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051223 5030 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 04 07:15:26.061124 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051226 5030 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 04 07:15:26.061124 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051229 5030 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 04 07:15:26.061124 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051232 5030 flags.go:64] FLAG: --image-service-endpoint="" Nov 04 07:15:26.061124 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051235 5030 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 04 07:15:26.061124 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051238 5030 flags.go:64] FLAG: --kube-api-burst="100" Nov 04 07:15:26.061124 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051242 5030 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051245 5030 flags.go:64] FLAG: --kube-api-qps="50" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051250 5030 flags.go:64] FLAG: --kube-reserved="" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051253 5030 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051256 5030 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051259 5030 flags.go:64] FLAG: --kubelet-cgroups="" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051262 5030 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051264 5030 flags.go:64] FLAG: --lock-file="" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051267 5030 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051270 5030 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051273 5030 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051279 5030 flags.go:64] FLAG: --log-json-split-stream="false" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051281 5030 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051284 5030 flags.go:64] FLAG: --log-text-split-stream="false" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051288 5030 flags.go:64] FLAG: --logging-format="text" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051291 5030 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051294 5030 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051297 5030 flags.go:64] FLAG: --manifest-url="" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051299 5030 flags.go:64] FLAG: --manifest-url-header="" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051304 5030 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051307 5030 flags.go:64] FLAG: --max-open-files="1000000" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051311 5030 flags.go:64] FLAG: --max-pods="110" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051314 5030 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051317 5030 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051320 5030 flags.go:64] FLAG: --memory-manager-policy="None" Nov 04 07:15:26.062115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051328 5030 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051331 5030 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051334 5030 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051337 5030 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051343 5030 flags.go:64] FLAG: --node-status-max-images="50" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051347 5030 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051350 5030 flags.go:64] FLAG: --oom-score-adj="-999" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051354 5030 flags.go:64] FLAG: --pod-cidr="" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051357 5030 flags.go:64] FLAG: --pod-manifest-path="" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051362 5030 flags.go:64] FLAG: --pod-max-pids="-1" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051365 5030 flags.go:64] FLAG: --pods-per-core="0" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051368 5030 flags.go:64] FLAG: --port="10250" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051371 5030 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051374 5030 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-0623a036c904b4706" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051377 5030 flags.go:64] FLAG: --qos-reserved="" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051380 5030 flags.go:64] FLAG: --read-only-port="10255" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051383 5030 flags.go:64] FLAG: --register-node="true" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051386 5030 flags.go:64] FLAG: --register-with-taints="" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051390 5030 flags.go:64] FLAG: --registry-burst="10" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051393 5030 flags.go:64] FLAG: --registry-qps="5" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051395 5030 flags.go:64] FLAG: --reserved-cpus="" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051398 5030 flags.go:64] FLAG: --reserved-memory="" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051402 5030 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051405 5030 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051408 5030 flags.go:64] FLAG: --rotate-certificates="false" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051411 5030 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 04 07:15:26.063309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051414 5030 flags.go:64] FLAG: --runonce="false" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051416 5030 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051419 5030 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051422 5030 flags.go:64] FLAG: --seccomp-default="false" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051425 5030 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051428 5030 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051431 5030 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051440 5030 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051443 5030 flags.go:64] FLAG: --storage-driver-password="root" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051446 5030 flags.go:64] FLAG: --storage-driver-secure="false" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051449 5030 flags.go:64] FLAG: --storage-driver-table="stats" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051452 5030 flags.go:64] FLAG: --storage-driver-user="root" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051455 5030 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051460 5030 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051463 5030 flags.go:64] FLAG: --system-cgroups="" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051470 5030 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051475 5030 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051478 5030 flags.go:64] FLAG: --tls-cert-file="" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051481 5030 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051488 5030 flags.go:64] FLAG: --tls-min-version="" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051490 5030 flags.go:64] FLAG: --tls-private-key-file="" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051493 5030 flags.go:64] FLAG: --topology-manager-policy="none" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051496 5030 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051500 5030 flags.go:64] FLAG: --topology-manager-scope="container" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051502 5030 flags.go:64] FLAG: --v="2" Nov 04 07:15:26.064413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051507 5030 flags.go:64] FLAG: --version="false" Nov 04 07:15:26.065088 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051511 5030 flags.go:64] FLAG: --vmodule="" Nov 04 07:15:26.065088 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051515 5030 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 04 07:15:26.065088 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.051519 5030 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 04 07:15:26.065088 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052720 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 07:15:26.065088 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052737 5030 feature_gate.go:386] unrecognized feature gate: Example Nov 04 07:15:26.065088 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052741 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 07:15:26.065088 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052744 5030 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 07:15:26.065088 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052748 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 07:15:26.065088 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052751 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 07:15:26.065088 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052754 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 07:15:26.065088 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052757 5030 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 07:15:26.065088 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052759 5030 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 07:15:26.065088 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052762 5030 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 07:15:26.065088 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052765 5030 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 07:15:26.065088 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052768 5030 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 07:15:26.065088 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052771 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 07:15:26.065088 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052776 5030 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 07:15:26.065088 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052780 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 07:15:26.065088 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052784 5030 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 07:15:26.065088 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052791 5030 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 07:15:26.065588 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052794 5030 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 07:15:26.065588 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052797 5030 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 07:15:26.065588 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052800 5030 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 07:15:26.065588 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052804 5030 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 07:15:26.065588 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052807 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 07:15:26.065588 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052810 5030 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 07:15:26.065588 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052812 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 07:15:26.065588 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052815 5030 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 07:15:26.065588 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052818 5030 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 07:15:26.065588 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052820 5030 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 07:15:26.065588 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052823 5030 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 07:15:26.065588 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052826 5030 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 07:15:26.065588 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052828 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 07:15:26.065588 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052831 5030 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 07:15:26.065588 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052834 5030 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 07:15:26.065588 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052836 5030 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 07:15:26.065588 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052839 5030 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 07:15:26.065588 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052842 5030 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 07:15:26.065588 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052844 5030 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 07:15:26.065588 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052847 5030 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 07:15:26.066063 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052850 5030 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 07:15:26.066063 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052854 5030 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 07:15:26.066063 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052859 5030 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 07:15:26.066063 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052864 5030 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 07:15:26.066063 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052867 5030 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 07:15:26.066063 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052870 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 07:15:26.066063 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052873 5030 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 07:15:26.066063 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052875 5030 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 07:15:26.066063 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052878 5030 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 07:15:26.066063 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052880 5030 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 07:15:26.066063 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052883 5030 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 07:15:26.066063 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052887 5030 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 07:15:26.066063 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052890 5030 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 07:15:26.066063 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052893 5030 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 07:15:26.066063 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052896 5030 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 07:15:26.066063 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052899 5030 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 07:15:26.066063 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052902 5030 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 07:15:26.066063 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052904 5030 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 07:15:26.066063 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052907 5030 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 07:15:26.066063 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052909 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 07:15:26.066575 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052912 5030 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 07:15:26.066575 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052915 5030 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 07:15:26.066575 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052917 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 07:15:26.066575 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052920 5030 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 07:15:26.066575 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052923 5030 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 07:15:26.066575 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052926 5030 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 07:15:26.066575 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052930 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 07:15:26.066575 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052934 5030 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 07:15:26.066575 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052938 5030 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 07:15:26.066575 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052941 5030 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 07:15:26.066575 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052944 5030 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 07:15:26.066575 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052947 5030 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 07:15:26.066575 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052949 5030 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 07:15:26.066575 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052952 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 07:15:26.066575 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052954 5030 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 07:15:26.066575 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052957 5030 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 07:15:26.066575 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052960 5030 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 07:15:26.066575 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052962 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 07:15:26.066575 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052965 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 07:15:26.067019 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052967 5030 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 07:15:26.067019 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052970 5030 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 07:15:26.067019 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052973 5030 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 07:15:26.067019 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052975 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 07:15:26.067019 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052979 5030 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 07:15:26.067019 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052982 5030 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 07:15:26.067019 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052985 5030 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 07:15:26.067019 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052996 5030 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 07:15:26.067019 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.052998 5030 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 07:15:26.067019 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053001 5030 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 07:15:26.067019 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053004 5030 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 07:15:26.067019 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053006 5030 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 07:15:26.067019 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053009 5030 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 07:15:26.067019 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053012 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 07:15:26.067019 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053015 5030 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 07:15:26.067019 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053017 5030 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 07:15:26.067019 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053020 5030 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 07:15:26.067019 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053022 5030 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 07:15:26.067019 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053025 5030 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 07:15:26.067019 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053027 5030 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 07:15:26.067503 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053030 5030 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 07:15:26.067503 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053033 5030 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 07:15:26.067503 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053036 5030 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 07:15:26.067503 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053038 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 07:15:26.067503 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053041 5030 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 07:15:26.067503 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053043 5030 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 07:15:26.067503 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053046 5030 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 07:15:26.067503 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053049 5030 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 07:15:26.067503 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053051 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 07:15:26.067503 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053054 5030 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 07:15:26.067503 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.053084 5030 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 07:15:26.067503 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053127 5030 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 07:15:26.067503 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053152 5030 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 07:15:26.067503 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053156 5030 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 07:15:26.067503 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053159 5030 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 07:15:26.067503 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053162 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 07:15:26.067883 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053165 5030 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 07:15:26.067883 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053169 5030 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 07:15:26.067883 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053171 5030 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 07:15:26.067883 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053174 5030 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 07:15:26.067883 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053183 5030 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 07:15:26.067883 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053186 5030 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 07:15:26.067883 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053189 5030 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 07:15:26.067883 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053192 5030 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 07:15:26.067883 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053195 5030 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 07:15:26.067883 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053197 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 07:15:26.067883 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053200 5030 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 07:15:26.067883 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053202 5030 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 07:15:26.067883 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053205 5030 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 07:15:26.067883 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053208 5030 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 07:15:26.067883 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053210 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 07:15:26.067883 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053213 5030 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 07:15:26.067883 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053216 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 07:15:26.067883 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053218 5030 feature_gate.go:386] unrecognized feature gate: Example Nov 04 07:15:26.067883 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053221 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 07:15:26.067883 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053223 5030 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 07:15:26.068359 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053226 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 07:15:26.068359 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053228 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 07:15:26.068359 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053231 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 07:15:26.068359 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053233 5030 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 07:15:26.068359 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053236 5030 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 07:15:26.068359 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053238 5030 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 07:15:26.068359 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053241 5030 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 07:15:26.068359 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053244 5030 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 07:15:26.068359 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053246 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 07:15:26.068359 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053250 5030 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 07:15:26.068359 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053253 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 07:15:26.068359 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053255 5030 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 07:15:26.068359 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053258 5030 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 07:15:26.068359 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053262 5030 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 07:15:26.068359 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053264 5030 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 07:15:26.068359 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053267 5030 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 07:15:26.068359 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053270 5030 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 07:15:26.068359 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053278 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 07:15:26.068359 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053281 5030 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 07:15:26.068359 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053284 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 07:15:26.068832 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053286 5030 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 07:15:26.068832 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053289 5030 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 07:15:26.068832 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053292 5030 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 07:15:26.068832 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053294 5030 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 07:15:26.068832 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053297 5030 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 07:15:26.068832 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053299 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 07:15:26.068832 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053302 5030 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 07:15:26.068832 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053305 5030 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 07:15:26.068832 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053308 5030 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 07:15:26.068832 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053310 5030 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 07:15:26.068832 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053313 5030 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 07:15:26.068832 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053316 5030 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 07:15:26.068832 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053318 5030 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 07:15:26.068832 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053321 5030 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 07:15:26.068832 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053323 5030 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 07:15:26.068832 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053326 5030 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 07:15:26.068832 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053329 5030 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 07:15:26.068832 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053332 5030 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 07:15:26.068832 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053334 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 07:15:26.068832 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053337 5030 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 07:15:26.069341 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053339 5030 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 07:15:26.069341 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053343 5030 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 07:15:26.069341 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053346 5030 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 07:15:26.069341 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053348 5030 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 07:15:26.069341 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053351 5030 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 07:15:26.069341 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053354 5030 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 07:15:26.069341 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053357 5030 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 07:15:26.069341 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053360 5030 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 07:15:26.069341 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053363 5030 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 07:15:26.069341 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053365 5030 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 07:15:26.069341 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053369 5030 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 07:15:26.069341 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053371 5030 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 07:15:26.069341 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053374 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 07:15:26.069341 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053376 5030 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 07:15:26.069341 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053379 5030 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 07:15:26.069341 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053382 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 07:15:26.069341 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053384 5030 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 07:15:26.069341 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053387 5030 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 07:15:26.069341 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053390 5030 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 07:15:26.069808 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053394 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 07:15:26.069808 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053398 5030 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 07:15:26.069808 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053401 5030 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 07:15:26.069808 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053404 5030 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 07:15:26.069808 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053406 5030 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 07:15:26.069808 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053409 5030 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 07:15:26.069808 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053412 5030 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 07:15:26.069808 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053414 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 07:15:26.069808 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053417 5030 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 07:15:26.069808 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053419 5030 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 07:15:26.069808 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053422 5030 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 07:15:26.069808 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053425 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 07:15:26.069808 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053428 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 07:15:26.069808 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053430 5030 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 07:15:26.069808 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053435 5030 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 07:15:26.069808 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053437 5030 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 07:15:26.069808 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053441 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 07:15:26.069808 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053444 5030 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 07:15:26.069808 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053447 5030 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 07:15:26.070329 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053450 5030 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 07:15:26.070329 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053453 5030 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 07:15:26.070329 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.053455 5030 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 07:15:26.070329 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.058163 5030 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 04 07:15:26.070329 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.058184 5030 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 04 07:15:26.070329 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.058213 5030 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 04 07:15:26.070329 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.058220 5030 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 04 07:15:26.070329 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058307 5030 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 07:15:26.070329 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058315 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 07:15:26.070329 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058323 5030 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 07:15:26.070329 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058331 5030 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 07:15:26.070329 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058337 5030 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 07:15:26.070329 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058343 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 07:15:26.070329 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058348 5030 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 07:15:26.070329 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058354 5030 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 07:15:26.070329 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058358 5030 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 07:15:26.070329 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058363 5030 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 07:15:26.070329 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058368 5030 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 07:15:26.070329 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058373 5030 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 07:15:26.070774 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058377 5030 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 07:15:26.070774 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058381 5030 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 07:15:26.070774 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058385 5030 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 07:15:26.070774 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058390 5030 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 07:15:26.070774 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058394 5030 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 07:15:26.070774 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058398 5030 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 07:15:26.070774 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058403 5030 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 07:15:26.070774 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058408 5030 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 07:15:26.070774 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058413 5030 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 07:15:26.070774 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058417 5030 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 07:15:26.070774 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058421 5030 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 07:15:26.070774 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058426 5030 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 07:15:26.070774 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058431 5030 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 07:15:26.070774 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058436 5030 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 07:15:26.070774 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058440 5030 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 07:15:26.070774 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058444 5030 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 07:15:26.070774 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058449 5030 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 07:15:26.070774 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058455 5030 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 07:15:26.070774 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058459 5030 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 07:15:26.070774 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058464 5030 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 07:15:26.071274 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058468 5030 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 07:15:26.071274 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058473 5030 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 07:15:26.071274 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058477 5030 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 07:15:26.071274 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058481 5030 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 07:15:26.071274 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058485 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 07:15:26.071274 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058490 5030 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 07:15:26.071274 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058494 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 07:15:26.071274 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058499 5030 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 07:15:26.071274 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058504 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 07:15:26.071274 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058509 5030 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 07:15:26.071274 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058513 5030 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 07:15:26.071274 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058517 5030 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 07:15:26.071274 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058521 5030 feature_gate.go:386] unrecognized feature gate: Example Nov 04 07:15:26.071274 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058525 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 07:15:26.071274 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058530 5030 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 07:15:26.071274 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058534 5030 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 07:15:26.071274 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058539 5030 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 07:15:26.071274 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058543 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 07:15:26.071274 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058547 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 07:15:26.071722 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058552 5030 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 07:15:26.071722 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058556 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 07:15:26.071722 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058560 5030 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 07:15:26.071722 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058567 5030 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 07:15:26.071722 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058574 5030 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 07:15:26.071722 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058580 5030 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 07:15:26.071722 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058585 5030 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 07:15:26.071722 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058590 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 07:15:26.071722 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058595 5030 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 07:15:26.071722 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058599 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 07:15:26.071722 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058603 5030 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 07:15:26.071722 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058609 5030 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 07:15:26.071722 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058613 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 07:15:26.071722 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058617 5030 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 07:15:26.071722 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058621 5030 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 07:15:26.071722 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058626 5030 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 07:15:26.071722 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058630 5030 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 07:15:26.071722 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058634 5030 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 07:15:26.071722 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058639 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 07:15:26.072228 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058643 5030 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 07:15:26.072228 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058647 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 07:15:26.072228 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058651 5030 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 07:15:26.072228 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058656 5030 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 07:15:26.072228 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058660 5030 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 07:15:26.072228 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058664 5030 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 07:15:26.072228 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058669 5030 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 07:15:26.072228 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058674 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 07:15:26.072228 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058678 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 07:15:26.072228 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058682 5030 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 07:15:26.072228 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058687 5030 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 07:15:26.072228 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058691 5030 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 07:15:26.072228 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058695 5030 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 07:15:26.072228 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058699 5030 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 07:15:26.072228 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058703 5030 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 07:15:26.072228 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058708 5030 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 07:15:26.072228 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058712 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 07:15:26.072228 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058717 5030 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 07:15:26.072228 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058722 5030 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 07:15:26.072228 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058726 5030 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 07:15:26.072709 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058730 5030 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 07:15:26.072709 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058735 5030 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 07:15:26.072709 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058739 5030 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 07:15:26.072709 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058743 5030 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 07:15:26.072709 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058747 5030 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 07:15:26.072709 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058752 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 07:15:26.072709 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058757 5030 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 07:15:26.072709 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058761 5030 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 07:15:26.072709 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058766 5030 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 07:15:26.072709 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058771 5030 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 07:15:26.072709 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058775 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 07:15:26.072709 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058779 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 07:15:26.072709 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058783 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 07:15:26.072709 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058790 5030 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 07:15:26.072709 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058795 5030 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 07:15:26.072709 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.058799 5030 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 07:15:26.073086 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.058839 5030 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 07:15:26.073086 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059073 5030 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 07:15:26.073086 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059084 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 07:15:26.073086 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059090 5030 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 07:15:26.073086 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059094 5030 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 07:15:26.073086 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059099 5030 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 07:15:26.073086 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059103 5030 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 07:15:26.073086 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059108 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 07:15:26.073086 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059112 5030 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 07:15:26.073086 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059117 5030 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 07:15:26.073086 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059121 5030 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 07:15:26.073086 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059126 5030 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 07:15:26.073086 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059147 5030 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 07:15:26.073086 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059152 5030 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 07:15:26.073086 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059156 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 07:15:26.073086 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059160 5030 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 07:15:26.073535 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059165 5030 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 07:15:26.073535 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059169 5030 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 07:15:26.073535 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059173 5030 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 07:15:26.073535 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059177 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 07:15:26.073535 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059182 5030 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 07:15:26.073535 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059187 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 07:15:26.073535 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059192 5030 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 07:15:26.073535 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059197 5030 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 07:15:26.073535 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059201 5030 feature_gate.go:386] unrecognized feature gate: Example Nov 04 07:15:26.073535 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059206 5030 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 07:15:26.073535 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059210 5030 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 07:15:26.073535 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059214 5030 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 07:15:26.073535 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059219 5030 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 07:15:26.073535 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059223 5030 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 07:15:26.073535 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059231 5030 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 07:15:26.073535 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059236 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 07:15:26.073535 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059241 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 07:15:26.073535 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059245 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 07:15:26.073535 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059249 5030 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 07:15:26.074002 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059254 5030 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 07:15:26.074002 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059258 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 07:15:26.074002 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059262 5030 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 07:15:26.074002 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059266 5030 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 07:15:26.074002 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059271 5030 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 07:15:26.074002 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059276 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 07:15:26.074002 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059280 5030 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 07:15:26.074002 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059284 5030 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 07:15:26.074002 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059289 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 07:15:26.074002 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059294 5030 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 07:15:26.074002 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059298 5030 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 07:15:26.074002 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059302 5030 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 07:15:26.074002 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059306 5030 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 07:15:26.074002 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059310 5030 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 07:15:26.074002 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059315 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 07:15:26.074002 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059320 5030 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 07:15:26.074002 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059324 5030 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 07:15:26.074002 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059328 5030 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 07:15:26.074002 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059333 5030 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 07:15:26.074002 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059337 5030 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 07:15:26.074705 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059342 5030 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 07:15:26.074705 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059347 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 07:15:26.074705 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059354 5030 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 07:15:26.074705 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059358 5030 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 07:15:26.074705 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059362 5030 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 07:15:26.074705 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059367 5030 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 07:15:26.074705 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059371 5030 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 07:15:26.074705 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059378 5030 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 07:15:26.074705 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059383 5030 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 07:15:26.074705 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059389 5030 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 07:15:26.074705 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059397 5030 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 07:15:26.074705 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059403 5030 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 07:15:26.074705 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059408 5030 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 07:15:26.074705 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059412 5030 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 07:15:26.074705 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059417 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 07:15:26.074705 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059422 5030 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 07:15:26.074705 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059426 5030 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 07:15:26.074705 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059430 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 07:15:26.075149 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059435 5030 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 07:15:26.075149 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059439 5030 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 07:15:26.075149 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059443 5030 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 07:15:26.075149 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059448 5030 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 07:15:26.075149 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059452 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 07:15:26.075149 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059456 5030 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 07:15:26.075149 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059461 5030 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 07:15:26.075149 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059465 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 07:15:26.075149 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059469 5030 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 07:15:26.075149 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059473 5030 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 07:15:26.075149 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059478 5030 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 07:15:26.075149 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059483 5030 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 07:15:26.075149 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059487 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 07:15:26.075149 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059491 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 07:15:26.075149 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059496 5030 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 07:15:26.075149 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059501 5030 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 07:15:26.075149 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059507 5030 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 07:15:26.075149 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059512 5030 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 07:15:26.075149 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059516 5030 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 07:15:26.075149 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059521 5030 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 07:15:26.075662 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059525 5030 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 07:15:26.075662 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059531 5030 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 07:15:26.075662 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059536 5030 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 07:15:26.075662 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059540 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 07:15:26.075662 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059544 5030 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 07:15:26.075662 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059549 5030 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 07:15:26.075662 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059553 5030 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 07:15:26.075662 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059557 5030 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 07:15:26.075662 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059561 5030 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 07:15:26.075662 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059566 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 07:15:26.075662 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059570 5030 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 07:15:26.075662 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059575 5030 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 07:15:26.075662 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059579 5030 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 07:15:26.075662 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059584 5030 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 07:15:26.075662 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.059624 5030 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 07:15:26.075662 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059675 5030 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 07:15:26.076065 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059682 5030 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 07:15:26.076065 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059687 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 07:15:26.076065 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059691 5030 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 07:15:26.076065 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059696 5030 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 07:15:26.076065 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059701 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 07:15:26.076065 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059705 5030 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 07:15:26.076065 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059710 5030 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 07:15:26.076065 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059714 5030 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 07:15:26.076065 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059718 5030 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 07:15:26.076065 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059722 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 07:15:26.076065 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059727 5030 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 07:15:26.076065 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059731 5030 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 07:15:26.076065 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059738 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 07:15:26.076065 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059743 5030 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 07:15:26.076065 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059747 5030 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 07:15:26.076065 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059752 5030 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 07:15:26.076065 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059756 5030 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 07:15:26.076065 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059760 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 07:15:26.076065 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059766 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 07:15:26.076815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059771 5030 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 07:15:26.076815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059775 5030 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 07:15:26.076815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059779 5030 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 07:15:26.076815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059784 5030 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 07:15:26.076815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059788 5030 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 07:15:26.076815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059793 5030 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 07:15:26.076815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059797 5030 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 07:15:26.076815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059802 5030 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 07:15:26.076815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059806 5030 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 07:15:26.076815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059810 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 07:15:26.076815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059814 5030 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 07:15:26.076815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059819 5030 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 07:15:26.076815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059823 5030 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 07:15:26.076815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059827 5030 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 07:15:26.076815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059832 5030 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 07:15:26.076815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059836 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 07:15:26.076815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059840 5030 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 07:15:26.076815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059845 5030 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 07:15:26.076815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059849 5030 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 07:15:26.076815 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059853 5030 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 07:15:26.077453 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059860 5030 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 07:15:26.077453 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059866 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 07:15:26.077453 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059872 5030 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 07:15:26.077453 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059876 5030 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 07:15:26.077453 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059881 5030 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 07:15:26.077453 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059887 5030 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 07:15:26.077453 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059892 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 07:15:26.077453 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059896 5030 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 07:15:26.077453 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059900 5030 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 07:15:26.077453 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059904 5030 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 07:15:26.077453 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059909 5030 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 07:15:26.077453 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059916 5030 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 07:15:26.077453 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059920 5030 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 07:15:26.077453 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059925 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 07:15:26.077453 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059929 5030 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 07:15:26.077453 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059933 5030 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 07:15:26.077453 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059938 5030 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 07:15:26.077453 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059942 5030 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 07:15:26.077453 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059947 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 07:15:26.078104 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059951 5030 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 07:15:26.078104 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059955 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 07:15:26.078104 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059960 5030 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 07:15:26.078104 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059964 5030 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 07:15:26.078104 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059969 5030 feature_gate.go:386] unrecognized feature gate: Example Nov 04 07:15:26.078104 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059973 5030 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 07:15:26.078104 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059977 5030 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 07:15:26.078104 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059981 5030 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 07:15:26.078104 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059987 5030 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 07:15:26.078104 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059991 5030 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 07:15:26.078104 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059995 5030 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 07:15:26.078104 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.059999 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 07:15:26.078104 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060004 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 07:15:26.078104 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060008 5030 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 07:15:26.078104 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060012 5030 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 07:15:26.078104 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060016 5030 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 07:15:26.078104 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060020 5030 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 07:15:26.078104 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060025 5030 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 07:15:26.078104 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060034 5030 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 07:15:26.078104 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060038 5030 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 07:15:26.078667 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060049 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 07:15:26.078667 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060053 5030 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 07:15:26.078667 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060058 5030 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 07:15:26.078667 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060063 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 07:15:26.078667 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060067 5030 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 07:15:26.078667 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060072 5030 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 07:15:26.078667 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060076 5030 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 07:15:26.078667 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060080 5030 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 07:15:26.078667 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060085 5030 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 07:15:26.078667 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060089 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 07:15:26.078667 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060094 5030 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 07:15:26.078667 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060098 5030 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 07:15:26.078667 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060102 5030 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 07:15:26.078667 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060106 5030 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 07:15:26.078667 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060110 5030 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 07:15:26.078667 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060115 5030 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 07:15:26.078667 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060119 5030 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 07:15:26.078667 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060123 5030 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 07:15:26.078667 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060143 5030 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 07:15:26.078667 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060148 5030 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 07:15:26.079217 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060152 5030 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 07:15:26.079217 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060157 5030 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 07:15:26.079217 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060161 5030 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 07:15:26.079217 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060165 5030 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 07:15:26.079217 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060174 5030 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 07:15:26.079217 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060180 5030 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 07:15:26.079217 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:26.060186 5030 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 07:15:26.079217 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.060300 5030 server.go:957] "Client rotation is on, will bootstrap in background" Nov 04 07:15:26.079217 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.061762 5030 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Nov 04 07:15:26.079217 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.061828 5030 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Nov 04 07:15:26.079217 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.062106 5030 server.go:1014] "Starting client certificate rotation" Nov 04 07:15:26.079217 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.062283 5030 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 04 07:15:26.079217 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.062327 5030 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 07:09:44 +0000 UTC" deadline="2028-04-13 08:14:37.725769175 +0000 UTC" Nov 04 07:15:26.079217 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.062377 5030 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12624h59m11.663393846s" Nov 04 07:15:26.079217 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.062883 5030 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 07:15:26.079629 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.076528 5030 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 07:15:26.079629 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.077847 5030 log.go:25] "Validated CRI v1 runtime API" Nov 04 07:15:26.079629 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.079505 5030 log.go:25] "Validated CRI v1 image API" Nov 04 07:15:26.080215 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.080202 5030 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 04 07:15:26.082609 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.082587 5030 fs.go:135] Filesystem UUIDs: map[2738c287-4295-49b1-91c1-82f2317160b8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 fdcd6fe9-fe02-40d3-9d9e-e8c68cef7e9b:/dev/nvme0n1p3] Nov 04 07:15:26.083561 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.082609 5030 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0cf6228fefe2c5bbe65e4c7db998766701c7db5eec337dcd1ceca0a953eaec17/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0cf6228fefe2c5bbe65e4c7db998766701c7db5eec337dcd1ceca0a953eaec17/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/14b30def96b8f2c9e04fae8c5c64c4de71b6a17186a15eca67789b82c7ea74f4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/14b30def96b8f2c9e04fae8c5c64c4de71b6a17186a15eca67789b82c7ea74f4/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/246bf3ef5c2f3f339c4d293e540ae9e30e0e82ef66477c7e99df996efba160c4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/246bf3ef5c2f3f339c4d293e540ae9e30e0e82ef66477c7e99df996efba160c4/userdata/shm major:0 minor:51 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/25f6f050986aedbcf4339b6d2b4ccaadab5a6669ce45c64e391320f81ac406f6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/25f6f050986aedbcf4339b6d2b4ccaadab5a6669ce45c64e391320f81ac406f6/userdata/shm major:0 minor:236 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2df83fc70ff880f345617e1601fd274fa84ef1b27285fc59dd1d35322f18bb96/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2df83fc70ff880f345617e1601fd274fa84ef1b27285fc59dd1d35322f18bb96/userdata/shm major:0 minor:240 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/454bb0b6dc7eb00960bf4110c14de7dfae55c00d2d3f22abe5a84e5787be7156/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/454bb0b6dc7eb00960bf4110c14de7dfae55c00d2d3f22abe5a84e5787be7156/userdata/shm major:0 minor:343 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4d38d912b136fb5f5470b2fba0b5d1f03ae9205cf789f883f6a0a7ff9949f152/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4d38d912b136fb5f5470b2fba0b5d1f03ae9205cf789f883f6a0a7ff9949f152/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5ab9f81141bc38e61168c61ad91076177308c680deb60704c5165939a7a0ef50/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5ab9f81141bc38e61168c61ad91076177308c680deb60704c5165939a7a0ef50/userdata/shm major:0 minor:296 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5b3dcb0308f656de86c07a5633e2ddb97e0ce28f17a4651a283125a26e60776f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5b3dcb0308f656de86c07a5633e2ddb97e0ce28f17a4651a283125a26e60776f/userdata/shm major:0 minor:93 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5d3e5946e4f744fc1ec695e229f3c583b19113bfd08abf9ed3944ff5bb723583/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5d3e5946e4f744fc1ec695e229f3c583b19113bfd08abf9ed3944ff5bb723583/userdata/shm major:0 minor:347 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/61a548d5257b781486bd4294d64173b5de90fa16d4535c5f3b3c5aa99ce51fbe/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/61a548d5257b781486bd4294d64173b5de90fa16d4535c5f3b3c5aa99ce51fbe/userdata/shm major:0 minor:311 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/628a302969088018110ee7753e32b4aa8d4f39da39b0832a0b8d819727307854/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/628a302969088018110ee7753e32b4aa8d4f39da39b0832a0b8d819727307854/userdata/shm major:0 minor:230 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6e4c81aeb7973fa6dc7d2b60da9378efed9a2d479b50b606f15e5f2f7797f907/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6e4c81aeb7973fa6dc7d2b60da9378efed9a2d479b50b606f15e5f2f7797f907/userdata/shm major:0 minor:241 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7ad20a10acc9272f7fa52fe175b8f2f275161c825207f71376292e64cf05cf56/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7ad20a10acc9272f7fa52fe175b8f2f275161c825207f71376292e64cf05cf56/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/80a1e3efdec7f95f504d8f4e3d76dc4541de9124562f0ffaf71d558ef1eb3b52/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/80a1e3efdec7f95f504d8f4e3d76dc4541de9124562f0ffaf71d558ef1eb3b52/userdata/shm major:0 minor:245 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/959ced276b531432be7722c74bba5d2693d5ab4f70dd8f061304eba6968b0bf4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/959ced276b531432be7722c74bba5d2693d5ab4f70dd8f061304eba6968b0bf4/userdata/shm major:0 minor:310 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9cdb734c69b80aaf29929edda6f94465bafa716d7d6a3dceda6c297013404b75/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9cdb734c69b80aaf29929edda6f94465bafa716d7d6a3dceda6c297013404b75/userdata/shm major:0 minor:294 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a5509809c751c430910a2569e551a28462352a9b2371e33e4c459f96b3e34581/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a5509809c751c430910a2569e551a28462352a9b2371e33e4c459f96b3e34581/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/abb5e5022356a91e742ca81e5b0daa931b63397a11a014376bbce87e3e906351/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/abb5e5022356a91e742ca81e5b0daa931b63397a11a014376bbce87e3e906351/userdata/shm major:0 minor:238 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b0ca8bec3585448148dcd43a929691b6def5d189b1a76f8b574ee5bcfe17b560/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b0ca8bec3585448148dcd43a929691b6def5d189b1a76f8b574ee5bcfe17b560/userdata/shm major:0 minor:234 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c24c19ef0235a10cb63a95a64160ae01699f6714fcd174b2bb5dede7588aa44b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c24c19ef0235a10cb63a95a64160ae01699f6714fcd174b2bb5dede7588aa44b/userdata/shm major:0 minor:228 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cd5fe46bcb2cb53656b520807a1233efd603cbe21e020c51ca947d78f923e8f0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cd5fe46bcb2cb53656b520807a1233efd603cbe21e020c51ca947d78f923e8f0/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d4ba5ffc38814a045f18074839e02aa31322b01984b4032258d0ac5cfa550207/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d4ba5ffc38814a045f18074839e02aa31322b01984b4032258d0ac5cfa550207/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e28118b37faf7b5bd1809f89939ca482ab5c3b491826233b3d8a06c6a6184aaa/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e28118b37faf7b5bd1809f89939ca482ab5c3b491826233b3d8a06c6a6184aaa/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e33bf94ac1cc337ed6f00b8bc0472da4e99b8dce7986547978993fc0385482e7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e33bf94ac1cc337ed6f00b8bc0472da4e99b8dce7986547978993fc0385482e7/userdata/shm major:0 minor:232 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e55ea405bbc35313793d14c6c44c152c28f1ba7074335190bf2d9a470d61eaf1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e55ea405bbc35313793d14c6c44c152c28f1ba7074335190bf2d9a470d61eaf1/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/042264b0-c105-41fa-89a5-fc386cb90f15/volumes/kubernetes.io~projected/kube-api-access-fw5d7:{mountpoint:/var/lib/kubelet/pods/042264b0-c105-41fa-89a5-fc386cb90f15/volumes/kubernetes.io~projected/kube-api-access-fw5d7 major:0 minor:346 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/042264b0-c105-41fa-89a5-fc386cb90f15/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/042264b0-c105-41fa-89a5-fc386cb90f15/volumes/kubernetes.io~secret/signing-key major:0 minor:345 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07b0128a-5ba7-40f9-9f0c-fbfeae05b64e/volumes/kubernetes.io~projected/kube-api-access-bfrm9:{mountpoint:/var/lib/kubelet/pods/07b0128a-5ba7-40f9-9f0c-fbfeae05b64e/volumes/kubernetes.io~projected/kube-api-access-bfrm9 major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd/volumes/kubernetes.io~projected/kube-api-access-lmp9d:{mountpoint:/var/lib/kubelet/pods/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd/volumes/kubernetes.io~projected/kube-api-access-lmp9d major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/20da56ab-0718-406e-80c4-d8fb20ac7049/volumes/kubernetes.io~projected/kube-api-access-s2bsc:{mountpoint:/var/lib/kubelet/pods/20da56ab-0718-406e-80c4-d8fb20ac7049/volumes/kubernetes.io~projected/kube-api-access-s2bsc major:0 minor:308 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3ea0ef4d-2fdb-4090-965f-3db3237a4c69/volumes/kubernetes.io~projected/kube-api-access-9vjds:{mountpoint:/var/lib/kubelet/pods/3ea0ef4d-2fdb-4090-965f-3db3237a4c69/volumes/kubernetes.io~projected/kube-api-access-9vjds major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/473ae29e-1292-4044-988e-293d9ae8cfe3/volumes/kubernetes.io~projected/kube-api-access-99mdk:{mountpoint:/var/lib/kubelet/pods/473ae29e-1292-4044-988e-293d9ae8cfe3/volumes/kubernetes.io~projected/kube-api-access-99mdk major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5240a510-6179-45d9-bb60-b3fc3054e304/volumes/kubernetes.io~projected/kube-api-access-q4fml:{mountpoint:/var/lib/kubelet/pods/5240a510-6179-45d9-bb60-b3fc3054e304/volumes/kubernetes.io~projected/kube-api-access-q4fml major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5977e1b4-8c3a-42b7-8e3a-e152fd907bd4/volumes/kubernetes.io~projected/kube-api-access-nh729:{mountpoint:/var/lib/kubelet/pods/5977e1b4-8c3a-42b7-8e3a-e152fd907bd4/volumes/kubernetes.io~projected/kube-api-access-nh729 major:0 minor:309 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6307c016-6fa4-4890-a9e5-0a0ad2f4a484/volumes/kubernetes.io~projected/kube-api-access-wzb6d:{mountpoint:/var/lib/kubelet/pods/6307c016-6fa4-4890-a9e5-0a0ad2f4a484/volumes/kubernetes.io~projected/kube-api-access-wzb6d major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6652cbf0-521e-411b-9f75-2ce1f7c6a05b/volumes/kubernetes.io~projected/kube-api-access-j8v8x:{mountpoint:/var/lib/kubelet/pods/6652cbf0-521e-411b-9f75-2ce1f7c6a05b/volumes/kubernetes.io~projected/kube-api-access-j8v8x major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6652cbf0-521e-411b-9f75-2ce1f7c6a05b/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/6652cbf0-521e-411b-9f75-2ce1f7c6a05b/volumes/kubernetes.io~secret/cert major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/706127dc-f1c4-4724-aa56-ba5c5623bcf4/volumes/kubernetes.io~projected/kube-api-access-fctt9:{mountpoint:/var/lib/kubelet/pods/706127dc-f1c4-4724-aa56-ba5c5623bcf4/volumes/kubernetes.io~projected/kube-api-access-fctt9 major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/712361a9-8da4-4367-b3e9-a60bdc909482/volumes/kubernetes.io~projected/kube-api-access-gwmcz:{mountpoint:/var/lib/kubelet/pods/712361a9-8da4-4367-b3e9-a60bdc909482/volumes/kubernetes.io~projected/kube-api-access-gwmcz major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8949591f-9c25-4e76-a673-67eb381ea2e0/volumes/kubernetes.io~projected/kube-api-access-hmgtx:{mountpoint:/var/lib/kubelet/pods/8949591f-9c25-4e76-a673-67eb381ea2e0/volumes/kubernetes.io~projected/kube-api-access-hmgtx major:0 minor:330 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8deda5b1-d839-4a8b-b902-8e341ffe5340/volumes/kubernetes.io~projected/kube-api-access-zsp74:{mountpoint:/var/lib/kubelet/pods/8deda5b1-d839-4a8b-b902-8e341ffe5340/volumes/kubernetes.io~projected/kube-api-access-zsp74 major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9084f3dd-8da4-431c-8040-1e268c3fa964/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/9084f3dd-8da4-431c-8040-1e268c3fa964/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9084f3dd-8da4-431c-8040-1e268c3fa964/volumes/kubernetes.io~projected/kube-api-access-lngkw:{mountpoint:/var/lib/kubelet/pods/9084f3dd-8da4-431c-8040-1e268c3fa964/volumes/kubernetes.io~projected/kube-api-access-lngkw major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9084f3dd-8da4-431c-8040-1e268c3fa964/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/9084f3dd-8da4-431c-8040-1e268c3fa964/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb/volumes/kubernetes.io~projected/kube-api-access-6w6vl:{mountpoint:/var/lib/kubelet/pods/9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb/volumes/kubernetes.io~projected/kube-api-access-6w6vl major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb/volumes/kubernetes.io~secret/serving-cert major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9b959b9f-cdaa-46cf-9775-593ee2ee7ed5/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/9b959b9f-cdaa-46cf-9775-593ee2ee7ed5/volumes/kubernetes.io~secret/agent-certs major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9f9af642-8ada-4711-b1d1-e6b086e6b16c/volumes/kubernetes.io~projected/kube-api-access-4d8m5:{mountpoint:/var/lib/kubelet/pods/9f9af642-8ada-4711-b1d1-e6b086e6b16c/volumes/kubernetes.io~projected/kube-api-access-4d8m5 major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9f9af642-8ada-4711-b1d1-e6b086e6b16c/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/9f9af642-8ada-4711-b1d1-e6b086e6b16c/volumes/kubernetes.io~secret/serving-cert major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a1971526-e34c-4dd8-9c6c-b6d9d13356c1/volumes/kubernetes.io~projected/kube-api-access-pcs6z:{mountpoint:/var/lib/kubelet/pods/a1971526-e34c-4dd8-9c6c-b6d9d13356c1/volumes/kubernetes.io~projected/kube-api-access-pcs6z major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a1971526-e34c-4dd8-9c6c-b6d9d13356c1/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/a1971526-e34c-4dd8-9c6c-b6d9d13356c1/volumes/kubernetes.io~secret/serving-cert major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aa159b4a-95ad-4a99-ae91-995c34fc44c1/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/aa159b4a-95ad-4a99-ae91-995c34fc44c1/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb/volumes/kubernetes.io~projected/kube-api-access-9tjsb:{mountpoint:/var/lib/kubelet/pods/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb/volumes/kubernetes.io~projected/kube-api-access-9tjsb major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ab2d1249-7775-4410-a8ef-8e03a4b362b9/volumes/kubernetes.io~projected/kube-api-access-629vw:{mountpoint:/var/lib/kubelet/pods/ab2d1249-7775-4410-a8ef-8e03a4b362b9/volumes/kubernetes.io~projected/kube-api-access-629vw major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b8c5588a-b014-4899-bef7-bbb6b6bfebd4/volumes/kubernetes.io~projected/kube-api-access-7ndw7:{mountpoint:/var/lib/kubelet/pods/b8c5588a-b014-4899-bef7-bbb6b6bfebd4/volumes/kubernetes.io~projected/kube-api-access-7ndw7 major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c96c91ba-0da0-4c2c-a881-e3ffffe63714/volumes/kubernetes.io~projected/kube-api-access-t66qf:{mountpoint:/var/lib/kubelet/pods/c96c91ba-0da0-4c2c-a881-e3ffffe63714/volumes/kubernetes.io~projected/kube-api-access-t66qf major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c96c91ba-0da0-4c2c-a881-e3ffffe63714/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/c96c91ba-0da0-4c2c-a881-e3ffffe63714/volumes/kubernetes.io~secret/default-certificate major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c96c91ba-0da0-4c2c-a881-e3ffffe63714/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/c96c91ba-0da0-4c2c-a881-e3ffffe63714/volumes/kubernetes.io~secret/stats-auth major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d31ffcc4-d558-4eec-94c0-3a6268fca6d3/volumes/kubernetes.io~projected/kube-api-access-tc8w7:{mountpoint:/var/lib/kubelet/pods/d31ffcc4-d558-4eec-94c0-3a6268fca6d3/volumes/kubernetes.io~projected/kube-api-access-tc8w7 major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d67d15cf-297b-4613-a63b-3c6dfa88bf8f/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/d67d15cf-297b-4613-a63b-3c6dfa88bf8f/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d67d15cf-297b-4613-a63b-3c6dfa88bf8f/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/d67d15cf-297b-4613-a63b-3c6dfa88bf8f/volumes/kubernetes.io~empty-dir/tmp major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d67d15cf-297b-4613-a63b-3c6dfa88bf8f/volumes/kubernetes.io~projected/kube-api-access-zcpx4:{mountpoint:/var/lib/kubelet/pods/d67d15cf-297b-4613-a63b-3c6dfa88bf8f/volumes/kubernetes.io~projected/kube-api-access-zcpx4 major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dba52b0f-ebd1-410c-b0bf-f4acc5d295dd/volumes/kubernetes.io~projected/kube-api-access-xqmtc:{mountpoint:/var/lib/kubelet/pods/dba52b0f-ebd1-410c-b0bf-f4acc5d295dd/volumes/kubernetes.io~projected/kube-api-access-xqmtc major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dfb5c54b-81e0-4f3a-92de-ea544696ee4b/volumes/kubernetes.io~projected/kube-api-access-986mn:{mountpoint:/var/lib/kubelet/pods/dfb5c54b-81e0-4f3a-92de-ea544696ee4b/volumes/kubernetes.io~projected/kube-api-access-986mn major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e87e5256-fef7-4160-b3d9-c96d0c01641a/volumes/kubernetes.io~projected/kube-api-access-n7hld:{mountpoint:/var/lib/kubelet/pods/e87e5256-fef7-4160-b3d9-c96d0c01641a/volumes/kubernetes.io~projected/kube-api-access-n7hld major:0 minor:349 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ecfd331a-08c4-43ac-a58c-9f43935d06ed/volumes/kubernetes.io~projected/kube-api-access-vqzcl:{mountpoint:/var/lib/kubelet/pods/ecfd331a-08c4-43ac-a58c-9f43935d06ed/volumes/kubernetes.io~projected/kube-api-access-vqzcl major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ecfd331a-08c4-43ac-a58c-9f43935d06ed/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/ecfd331a-08c4-43ac-a58c-9f43935d06ed/volumes/kubernetes.io~secret/serving-cert major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ee3c09af-7a35-49ff-a0cb-4bafc08875b1/volumes/kubernetes.io~projected/kube-api-access-r5dxh:{mountpoint:/var/lib/kubelet/pods/ee3c09af-7a35-49ff-a0cb-4bafc08875b1/volumes/kubernetes.io~projected/kube-api-access-r5dxh major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f12932cd-facc-4cf2-bd45-d359ae6d6012/volumes/kubernetes.io~projected/kube-api-access-5v2qr:{mountpoint:/var/lib/kubelet/pods/f12932cd-facc-4cf2-bd45-d359ae6d6012/volumes/kubernetes.io~projected/kube-api-access-5v2qr major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fb5b977d-e13b-4499-8f7d-57b96f1b62bb/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/fb5b977d-e13b-4499-8f7d-57b96f1b62bb/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fb5b977d-e13b-4499-8f7d-57b96f1b62bb/volumes/kubernetes.io~projected/kube-api-access-mknjr:{mountpoint:/var/lib/kubelet/pods/fb5b977d-e13b-4499-8f7d-57b96f1b62bb/volumes/kubernetes.io~projected/kube-api-access-mknjr major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fb5b977d-e13b-4499-8f7d-57b96f1b62bb/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/fb5b977d-e13b-4499-8f7d-57b96f1b62bb/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fb5b977d-e13b-4499-8f7d-57b96f1b62bb/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/fb5b977d-e13b-4499-8f7d-57b96f1b62bb/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:197 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/848a719d5ec8decb2627852b7a564a78974497589d07abee319fafec597062a7/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/5b2d7bbb4fe5b26240e06185d0526817431621c3bb99c0280d04541d5f8b7e1d/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/6e097dfd87db0b3675fa4a61ff7a8806cfe1e576f9989dd5967280589f162f06/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/994f34f8731739a5b4bb77ff87b059c520309fd995a035a65ed4595b274828d0/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/71a7072bed0847b2158a56d2e796d9e28ccec7bcbc9afc9882ed0ff903aa6419/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/281ad3f0aa62217f7d0a32d1bc7b83fec58a780d365ddb2bd582cce3dcb33433/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/cf584ae5383e311c0e9118924488864b61a4c45a9d3d42d5edd16a0f78009d58/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/38d015f2a700db3898eee6dea4a8f135ecb3172ec3000a1fea0bf649d116f16a/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/e8bc41e93052c086684678e0d30672191e262e9551fd1a226acef178b9433461/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/48fba38308f0081a0025007bb32b8d04412b2646cb01cc661d0d3ebafa6b368d/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/6ed11e53b0fec462e0f0fa4c8ec51068b630b066fe80efae7411c2653c78687b/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-146:{mountpoint:/var/lib/containers/storage/overlay/93a274fe64cbf3233ecddcd55f23844c274d14ab8738c68682a7b03b95050cf7/merged major:0 minor:146 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/66868d8d073bbc183d3c16ab61af9307433ef46a897353c58fee4034b98c30a2/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/a0ee1feaaa952967c5d332bc7ae459ba4d75f96d0675cfd1b1fdda7d10ee123a/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/fc4ec5c3347726a953e0ffff2369e763c1367eecdc5ad48ad63b93508e26377d/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/ca81eb801dc4da8737267436ee814df3145b877242c316cc90a5e9e5338fce10/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/73fbb85731ea7efe9207a025ff5c1f3b081ac0e5f1fe1d33aede1b0c13173bc9/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/c957b6c19f05cac75314f4a8e98d70c095d153b81042ee54307d1e7735831b54/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/5fe8d42c62e218e0976602ad17a4f71493188bc0aaa9c6b32d990336e1225009/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/e5ceb7d6f0fc2c5a6501445511b4839ed2bdcf374dd412fe6a3bc11f1a21777f/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/3ea5cbcff3357ace83161bbc58f8faf2a45589153bd2433350d271871d7d964b/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/f6e4453ace8104b243000e0ce281e69d0ab26186ef9144ac745202a6e5cd6380/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/4b0c90293639865f4ac02ff8b42fc162e5762f9a20d991dc984f92a0dda88045/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/dab2ce2c691c3d622e369c0a3137183c161e75c34063a53ed1567b6e515db746/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/88287dbe73a27d81fe4cce7715b43365e2a20ac15443928d0dfdcbeed8f1bdc7/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/f3ab6ddb8e601f87b129961880c11db630889d1878a22d2245f9e69655206702/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/be1446e726812ca59c0287499d32d83aa7c171b48641e9bfc91588fca62420ee/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/91996bc416362033474fa041f99aa74fbcb3b1e7067134f2e5e4cf5a764a65b9/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/ff5f1f7337aa4271b6630116d4b7d10da012b1b03e3f952e42af0594fc221f2b/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/a987f6be4955da1829ebafa5d597fd5c09c8b3ca4edd27796309dac77d0926ab/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-265:{mountpoint:/var/lib/containers/storage/overlay/1a2f4d1de8dc7e5c30b87a398d662810fc73f49b5f5d93ad8ad01e27266139cd/merged major:0 minor:265 fsType:overlay blockSize:0} overlay_0-278:{mountpoint:/var/lib/containers/storage/overlay/c07c7a66cbd937ef93140a8a3efb9cc745c8b1b9475b659cc3d1bbf5f0231af1/merged major:0 minor:278 fsType:overlay blockSize:0} overlay_0-281:{mountpoint:/var/lib/containers/storage/overlay/6b47708b1965e2cda931343f3ac978dde3ffd7f34d559b168a7edf6438705868/merged major:0 minor:281 fsType:overlay blockSize:0} overlay_0-283:{mountpoint:/var/lib/containers/storage/overlay/afa0405329a1d768e5ed5f0309f2916529f561745820d9f5c675949b4356aa03/merged major:0 minor:283 fsType:overlay blockSize:0} overlay_0-285:{mountpoint:/var/lib/containers/storage/overlay/f5272e37b4f08ef3b2e109b008b0e799505798e2ca3b6fbca7171f0a5db76420/merged major:0 minor:285 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/91b8f09d8fabb0f96c76f6d764cc57852c5b79d49a2f5d99616b4d1783421a19/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/4878e11dc2651e67a04093df136564fb89b604e6f20dadb5ec6fa87ff8e3616b/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-306:{mountpoint:/var/lib/containers/storage/overlay/889613075ad8d8031cb3457a3195b2aa7c0b2148bffcf1369129ee64b451922e/merged major:0 minor:306 fsType:overlay blockSize:0} overlay_0-314:{mountpoint:/var/lib/containers/storage/overlay/b5857657fa59714fb732fc4744de48317df319632442e580ca6f6e4ab14b6266/merged major:0 minor:314 fsType:overlay blockSize:0} overlay_0-316:{mountpoint:/var/lib/containers/storage/overlay/10ccfdd9d1a4066f0cb4fa4f593a33f7d8f85c4dcc8ea1eb21b7128591732bf5/merged major:0 minor:316 fsType:overlay blockSize:0} overlay_0-318:{mountpoint:/var/lib/containers/storage/overlay/3ae6348cfebc147d3eedda2b99b5048a6c1937e568b6e621ad99821542cb58af/merged major:0 minor:318 fsType:overlay blockSize:0} overlay_0-320:{mountpoint:/var/lib/containers/storage/overlay/a47b0b763e0b93b81677270e8cd47a21b6e86407f0d9b60dba8a2bcf8cf4bc75/merged major:0 minor:320 fsType:overlay blockSize:0} overlay_0-322:{mountpoint:/var/lib/containers/storage/overlay/e55559c909ef4d3d29533f6a6d6b9ce5167acfe16635eb0d7d74ba2d14e1709e/merged major:0 minor:322 fsType:overlay blockSize:0} overlay_0-328:{mountpoint:/var/lib/containers/storage/overlay/61ce614551a28cce72b4582f8e936d374629932910cfefb494ac612f4bcecd1e/merged major:0 minor:328 fsType:overlay blockSize:0} overlay_0-350:{mountpoint:/var/lib/containers/storage/overlay/c4c31c5991e62a7c0df03a9d96e0c0fe4c9aafc9baa045feb630a1fa82615bd1/merged major:0 minor:350 fsType:overlay blockSize:0} overlay_0-352:{mountpoint:/var/lib/containers/storage/overlay/2128843317e4666cd9acf97c4b4e9aa9a0004f45056ab381bf1796165d4c4e38/merged major:0 minor:352 fsType:overlay blockSize:0} overlay_0-354:{mountpoint:/var/lib/containers/storage/overlay/e038bd284b86a1cdff857333eae19bccc6b8be6298c37850d92f47e3c1f13219/merged major:0 minor:354 fsType:overlay blockSize:0} overlay_0-360:{mountpoint:/var/lib/containers/storage/overlay/3f57b8b53fc3aa4530fdd322eccd2d45abf829ae4c82d16b6e603ee151576bcb/merged major:0 minor:360 fsType:overlay blockSize:0} overlay_0-362:{mountpoint:/var/lib/containers/storage/overlay/01b250b26deead7518216c0c58b23713ad5031968c62d7063a7c2f98acdce59e/merged major:0 minor:362 fsType:overlay blockSize:0} overlay_0-368:{mountpoint:/var/lib/containers/storage/overlay/c241600dd9cf501c4f668c28dfa00eda12a47e301b08f83c76e847830d8e5088/merged major:0 minor:368 fsType:overlay blockSize:0} overlay_0-370:{mountpoint:/var/lib/containers/storage/overlay/aeae37d507e817415bb0a39602fffc201fda07624fec3b66a74ff973fdad20d2/merged major:0 minor:370 fsType:overlay blockSize:0} overlay_0-380:{mountpoint:/var/lib/containers/storage/overlay/6266d2e9065ab6652df9f8faddf1be9c3ed48432276fa82abfc36e79bd69ee6d/merged major:0 minor:380 fsType:overlay blockSize:0} overlay_0-49:{mountpoint:/var/lib/containers/storage/overlay/07c5ce63100b2117d5991bb23db113afeafc95977ae325acc494e31dea09b7b7/merged major:0 minor:49 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/67ffa608de0962529a56f4788dabc85e4d0af1696730858fd9c14aabf0fd7267/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/a51d850e914d2abecc08363bc6bcf28df2f75ee24f0f4247d17601a55a94fb39/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/73f876745bc315920ca1c2627449633027df66fa5022381ab05a774d2c442c1e/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/8d8f45a18cefa27be6f17f4447380647c0b4cc18fd7f2208225e20720c9e4d22/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/481d153ac3a4bf7e46ffa7def23c94e22171b855d4b03980e78bcd987a4eef3c/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/e76a42c743df168050c6eee0b0537791c8d068d92f11eaefca2da48be5e47269/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/1213ff4d932e1e554eb91c4035e0a7d8b4d895b77474a39e8714225cb66b0b95/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/7eaf57b4d29176fbe54daed50e3c8a51a86854ce36957cfdabbee5707bd85701/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/6efa8b82ee05162d26c94f3a06ade0beb0cf0c1ab7fff4581b798f581f44b85c/merged major:0 minor:96 fsType:overlay blockSize:0}] Nov 04 07:15:26.092207 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.091766 5030 manager.go:217] Machine: {Timestamp:2026-11-04 07:15:26.091317399 +0000 UTC m=+0.073945601 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101270 MemoryCapacity:33164324864 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29d654461ca6fd516277d32761a8af SystemUUID:ec29d654-461c-a6fd-5162-77d32761a8af BootID:e07bda21-e71b-4cf1-a45e-d4049adee76f Filesystems:[{Device:overlay_0-278 DeviceMajor:0 DeviceMinor:278 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-146 DeviceMajor:0 DeviceMinor:146 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ecfd331a-08c4-43ac-a58c-9f43935d06ed/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:212 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/ecfd331a-08c4-43ac-a58c-9f43935d06ed/volumes/kubernetes.io~projected/kube-api-access-vqzcl DeviceMajor:0 DeviceMinor:220 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-306 DeviceMajor:0 DeviceMinor:306 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e87e5256-fef7-4160-b3d9-c96d0c01641a/volumes/kubernetes.io~projected/kube-api-access-n7hld DeviceMajor:0 DeviceMinor:349 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/d67d15cf-297b-4613-a63b-3c6dfa88bf8f/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:64 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb/volumes/kubernetes.io~projected/kube-api-access-9tjsb DeviceMajor:0 DeviceMinor:227 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-362 DeviceMajor:0 DeviceMinor:362 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/14b30def96b8f2c9e04fae8c5c64c4de71b6a17186a15eca67789b82c7ea74f4/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/9b959b9f-cdaa-46cf-9775-593ee2ee7ed5/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:62 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cd5fe46bcb2cb53656b520807a1233efd603cbe21e020c51ca947d78f923e8f0/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/61a548d5257b781486bd4294d64173b5de90fa16d4535c5f3b3c5aa99ce51fbe/userdata/shm DeviceMajor:0 DeviceMinor:311 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/6652cbf0-521e-411b-9f75-2ce1f7c6a05b/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:215 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/8deda5b1-d839-4a8b-b902-8e341ffe5340/volumes/kubernetes.io~projected/kube-api-access-zsp74 DeviceMajor:0 DeviceMinor:223 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-285 DeviceMajor:0 DeviceMinor:285 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-320 DeviceMajor:0 DeviceMinor:320 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-322 DeviceMajor:0 DeviceMinor:322 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/dba52b0f-ebd1-410c-b0bf-f4acc5d295dd/volumes/kubernetes.io~projected/kube-api-access-xqmtc DeviceMajor:0 DeviceMinor:59 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5b3dcb0308f656de86c07a5633e2ddb97e0ce28f17a4651a283125a26e60776f/userdata/shm DeviceMajor:0 DeviceMinor:93 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/712361a9-8da4-4367-b3e9-a60bdc909482/volumes/kubernetes.io~projected/kube-api-access-gwmcz DeviceMajor:0 DeviceMinor:207 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:214 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-318 DeviceMajor:0 DeviceMinor:318 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-49 DeviceMajor:0 DeviceMinor:49 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e55ea405bbc35313793d14c6c44c152c28f1ba7074335190bf2d9a470d61eaf1/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6307c016-6fa4-4890-a9e5-0a0ad2f4a484/volumes/kubernetes.io~projected/kube-api-access-wzb6d DeviceMajor:0 DeviceMinor:208 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e33bf94ac1cc337ed6f00b8bc0472da4e99b8dce7986547978993fc0385482e7/userdata/shm DeviceMajor:0 DeviceMinor:232 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-360 DeviceMajor:0 DeviceMinor:360 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-380 DeviceMajor:0 DeviceMinor:380 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/473ae29e-1292-4044-988e-293d9ae8cfe3/volumes/kubernetes.io~projected/kube-api-access-99mdk DeviceMajor:0 DeviceMinor:65 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/6652cbf0-521e-411b-9f75-2ce1f7c6a05b/volumes/kubernetes.io~projected/kube-api-access-j8v8x DeviceMajor:0 DeviceMinor:217 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c24c19ef0235a10cb63a95a64160ae01699f6714fcd174b2bb5dede7588aa44b/userdata/shm DeviceMajor:0 DeviceMinor:228 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/d67d15cf-297b-4613-a63b-3c6dfa88bf8f/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:63 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d4ba5ffc38814a045f18074839e02aa31322b01984b4032258d0ac5cfa550207/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/07b0128a-5ba7-40f9-9f0c-fbfeae05b64e/volumes/kubernetes.io~projected/kube-api-access-bfrm9 DeviceMajor:0 DeviceMinor:225 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/aa159b4a-95ad-4a99-ae91-995c34fc44c1/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:293 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/9084f3dd-8da4-431c-8040-1e268c3fa964/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:55 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b0ca8bec3585448148dcd43a929691b6def5d189b1a76f8b574ee5bcfe17b560/userdata/shm DeviceMajor:0 DeviceMinor:234 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7ad20a10acc9272f7fa52fe175b8f2f275161c825207f71376292e64cf05cf56/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-265 DeviceMajor:0 DeviceMinor:265 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:221 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9cdb734c69b80aaf29929edda6f94465bafa716d7d6a3dceda6c297013404b75/userdata/shm DeviceMajor:0 DeviceMinor:294 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/042264b0-c105-41fa-89a5-fc386cb90f15/volumes/kubernetes.io~projected/kube-api-access-fw5d7 DeviceMajor:0 DeviceMinor:346 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-370 DeviceMajor:0 DeviceMinor:370 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-281 DeviceMajor:0 DeviceMinor:281 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fb5b977d-e13b-4499-8f7d-57b96f1b62bb/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:197 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-352 DeviceMajor:0 DeviceMinor:352 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-354 DeviceMajor:0 DeviceMinor:354 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ee3c09af-7a35-49ff-a0cb-4bafc08875b1/volumes/kubernetes.io~projected/kube-api-access-r5dxh DeviceMajor:0 DeviceMinor:61 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/d67d15cf-297b-4613-a63b-3c6dfa88bf8f/volumes/kubernetes.io~projected/kube-api-access-zcpx4 DeviceMajor:0 DeviceMinor:66 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f12932cd-facc-4cf2-bd45-d359ae6d6012/volumes/kubernetes.io~projected/kube-api-access-5v2qr DeviceMajor:0 DeviceMinor:206 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/246bf3ef5c2f3f339c4d293e540ae9e30e0e82ef66477c7e99df996efba160c4/userdata/shm DeviceMajor:0 DeviceMinor:51 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/c96c91ba-0da0-4c2c-a881-e3ffffe63714/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:45 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/959ced276b531432be7722c74bba5d2693d5ab4f70dd8f061304eba6968b0bf4/userdata/shm DeviceMajor:0 DeviceMinor:310 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/dfb5c54b-81e0-4f3a-92de-ea544696ee4b/volumes/kubernetes.io~projected/kube-api-access-986mn DeviceMajor:0 DeviceMinor:224 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-316 DeviceMajor:0 DeviceMinor:316 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582164480 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2df83fc70ff880f345617e1601fd274fa84ef1b27285fc59dd1d35322f18bb96/userdata/shm DeviceMajor:0 DeviceMinor:240 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/454bb0b6dc7eb00960bf4110c14de7dfae55c00d2d3f22abe5a84e5787be7156/userdata/shm DeviceMajor:0 DeviceMinor:343 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/ab2d1249-7775-4410-a8ef-8e03a4b362b9/volumes/kubernetes.io~projected/kube-api-access-629vw DeviceMajor:0 DeviceMinor:60 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:211 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5ab9f81141bc38e61168c61ad91076177308c680deb60704c5165939a7a0ef50/userdata/shm DeviceMajor:0 DeviceMinor:296 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5977e1b4-8c3a-42b7-8e3a-e152fd907bd4/volumes/kubernetes.io~projected/kube-api-access-nh729 DeviceMajor:0 DeviceMinor:309 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-368 DeviceMajor:0 DeviceMinor:368 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a5509809c751c430910a2569e551a28462352a9b2371e33e4c459f96b3e34581/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fb5b977d-e13b-4499-8f7d-57b96f1b62bb/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:204 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/5240a510-6179-45d9-bb60-b3fc3054e304/volumes/kubernetes.io~projected/kube-api-access-q4fml DeviceMajor:0 DeviceMinor:205 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/80a1e3efdec7f95f504d8f4e3d76dc4541de9124562f0ffaf71d558ef1eb3b52/userdata/shm DeviceMajor:0 DeviceMinor:245 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/706127dc-f1c4-4724-aa56-ba5c5623bcf4/volumes/kubernetes.io~projected/kube-api-access-fctt9 DeviceMajor:0 DeviceMinor:67 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c96c91ba-0da0-4c2c-a881-e3ffffe63714/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:201 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/fb5b977d-e13b-4499-8f7d-57b96f1b62bb/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:202 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/fb5b977d-e13b-4499-8f7d-57b96f1b62bb/volumes/kubernetes.io~projected/kube-api-access-mknjr DeviceMajor:0 DeviceMinor:203 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-314 DeviceMajor:0 DeviceMinor:314 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b8c5588a-b014-4899-bef7-bbb6b6bfebd4/volumes/kubernetes.io~projected/kube-api-access-7ndw7 DeviceMajor:0 DeviceMinor:56 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/d31ffcc4-d558-4eec-94c0-3a6268fca6d3/volumes/kubernetes.io~projected/kube-api-access-tc8w7 DeviceMajor:0 DeviceMinor:58 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9084f3dd-8da4-431c-8040-1e268c3fa964/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/a1971526-e34c-4dd8-9c6c-b6d9d13356c1/volumes/kubernetes.io~projected/kube-api-access-pcs6z DeviceMajor:0 DeviceMinor:219 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-350 DeviceMajor:0 DeviceMinor:350 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8949591f-9c25-4e76-a673-67eb381ea2e0/volumes/kubernetes.io~projected/kube-api-access-hmgtx DeviceMajor:0 DeviceMinor:330 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0cf6228fefe2c5bbe65e4c7db998766701c7db5eec337dcd1ceca0a953eaec17/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:216 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/628a302969088018110ee7753e32b4aa8d4f39da39b0832a0b8d819727307854/userdata/shm DeviceMajor:0 DeviceMinor:230 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/20da56ab-0718-406e-80c4-d8fb20ac7049/volumes/kubernetes.io~projected/kube-api-access-s2bsc DeviceMajor:0 DeviceMinor:308 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/042264b0-c105-41fa-89a5-fc386cb90f15/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:345 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582160384 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e28118b37faf7b5bd1809f89939ca482ab5c3b491826233b3d8a06c6a6184aaa/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-283 DeviceMajor:0 DeviceMinor:283 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9084f3dd-8da4-431c-8040-1e268c3fa964/volumes/kubernetes.io~projected/kube-api-access-lngkw DeviceMajor:0 DeviceMinor:57 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a1971526-e34c-4dd8-9c6c-b6d9d13356c1/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:210 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb/volumes/kubernetes.io~projected/kube-api-access-6w6vl DeviceMajor:0 DeviceMinor:222 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/25f6f050986aedbcf4339b6d2b4ccaadab5a6669ce45c64e391320f81ac406f6/userdata/shm DeviceMajor:0 DeviceMinor:236 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4d38d912b136fb5f5470b2fba0b5d1f03ae9205cf789f883f6a0a7ff9949f152/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9f9af642-8ada-4711-b1d1-e6b086e6b16c/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:213 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/9f9af642-8ada-4711-b1d1-e6b086e6b16c/volumes/kubernetes.io~projected/kube-api-access-4d8m5 DeviceMajor:0 DeviceMinor:226 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/abb5e5022356a91e742ca81e5b0daa931b63397a11a014376bbce87e3e906351/userdata/shm DeviceMajor:0 DeviceMinor:238 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd/volumes/kubernetes.io~projected/kube-api-access-lmp9d DeviceMajor:0 DeviceMinor:288 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-328 DeviceMajor:0 DeviceMinor:328 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5d3e5946e4f744fc1ec695e229f3c583b19113bfd08abf9ed3944ff5bb723583/userdata/shm DeviceMajor:0 DeviceMinor:347 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c96c91ba-0da0-4c2c-a881-e3ffffe63714/volumes/kubernetes.io~projected/kube-api-access-t66qf DeviceMajor:0 DeviceMinor:209 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/3ea0ef4d-2fdb-4090-965f-3db3237a4c69/volumes/kubernetes.io~projected/kube-api-access-9vjds DeviceMajor:0 DeviceMinor:218 Capacity:31985725440 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6e4c81aeb7973fa6dc7d2b60da9378efed9a2d479b50b606f15e5f2f7797f907/userdata/shm DeviceMajor:0 DeviceMinor:241 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:25f6f050986aedb MacAddress:fe:77:66:9c:42:a9 Speed:10000 Mtu:8901} {Name:2df83fc70ff880f MacAddress:e6:4a:1d:0c:6d:db Speed:10000 Mtu:8901} {Name:454bb0b6dc7eb00 MacAddress:36:14:8f:91:e6:48 Speed:10000 Mtu:8901} {Name:5ab9f81141bc38e MacAddress:e2:bb:b9:e4:2b:fa Speed:10000 Mtu:8901} {Name:5d3e5946e4f744f MacAddress:ae:29:99:31:b9:5d Speed:10000 Mtu:8901} {Name:61a548d5257b781 MacAddress:f2:d5:92:97:d3:6c Speed:10000 Mtu:8901} {Name:628a30296908801 MacAddress:a2:7a:66:87:13:76 Speed:10000 Mtu:8901} {Name:6e4c81aeb7973fa MacAddress:96:20:bb:59:6e:4f Speed:10000 Mtu:8901} {Name:7ad20a10acc9272 MacAddress:56:a4:ca:87:14:c1 Speed:10000 Mtu:8901} {Name:80a1e3efdec7f95 MacAddress:0a:35:74:72:6d:dd Speed:10000 Mtu:8901} {Name:959ced276b53143 MacAddress:4a:a4:80:f3:0b:7e Speed:10000 Mtu:8901} {Name:9cdb734c69b80aa MacAddress:ea:c9:84:01:3c:12 Speed:10000 Mtu:8901} {Name:abb5e5022356a91 MacAddress:d6:5f:c8:a3:6d:94 Speed:10000 Mtu:8901} {Name:b0ca8bec3585448 MacAddress:ce:50:c5:c7:43:57 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:db:84:1a:ff Speed:0 Mtu:9001} {Name:br-int MacAddress:5a:60:8d:44:18:f7 Speed:0 Mtu:8901} {Name:c24c19ef0235a10 MacAddress:9e:c7:4e:f6:b9:c3 Speed:10000 Mtu:8901} {Name:e33bf94ac1cc337 MacAddress:be:d1:b3:4d:2f:00 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:db:84:1a:ff Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:da:01:72:8d:17:4a Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:ce:52:b7:9c:05:b6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164324864 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 04 07:15:26.092438 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.092211 5030 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 04 07:15:26.092438 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.092261 5030 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 04 07:15:26.092592 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.092563 5030 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 04 07:15:26.092711 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.092593 5030 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-91.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 04 07:15:26.092753 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.092713 5030 topology_manager.go:143] "Creating topology manager with none policy" Nov 04 07:15:26.092753 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.092720 5030 container_manager_linux.go:311] "Creating device plugin manager" Nov 04 07:15:26.092753 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.092730 5030 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 07:15:26.092753 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.092746 5030 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 07:15:26.092855 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.092764 5030 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 04 07:15:26.092930 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.092921 5030 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 04 07:15:26.093048 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.093039 5030 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 04 07:15:26.093080 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.093074 5030 kubelet.go:493] "Attempting to sync node with API server" Nov 04 07:15:26.093109 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.093088 5030 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 04 07:15:26.093109 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.093097 5030 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 04 07:15:26.093109 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.093105 5030 kubelet.go:405] "Adding apiserver pod source" Nov 04 07:15:26.093217 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.093127 5030 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 04 07:15:26.094125 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.094107 5030 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 04 07:15:26.094238 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.094120 5030 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 07:15:26.094652 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.094631 5030 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 04 07:15:26.097094 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.097081 5030 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 04 07:15:26.097094 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.097093 5030 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 07:15:26.097202 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.097192 5030 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Nov 04 07:15:26.097373 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.097363 5030 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 04 07:15:26.097404 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.097391 5030 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 04 07:15:26.097481 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.097472 5030 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 04 07:15:26.097510 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.097486 5030 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 04 07:15:26.097510 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.097493 5030 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 04 07:15:26.097510 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.097499 5030 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 04 07:15:26.097510 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.097504 5030 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 04 07:15:26.097510 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.097510 5030 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 04 07:15:26.097637 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.097515 5030 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 04 07:15:26.097637 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.097521 5030 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 04 07:15:26.097637 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.097528 5030 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 04 07:15:26.097637 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.097534 5030 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 04 07:15:26.097637 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.097548 5030 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 04 07:15:26.097637 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.097556 5030 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 04 07:15:26.097637 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.097579 5030 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 04 07:15:26.097637 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.097585 5030 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 04 07:15:26.101031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.101015 5030 server.go:1263] "Started kubelet" Nov 04 07:15:26.101102 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.101067 5030 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 04 07:15:26.101690 ip-10-0-130-91 systemd[1]: Started Kubernetes Kubelet. Nov 04 07:15:26.102626 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.101794 5030 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 04 07:15:26.102715 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.102635 5030 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 04 07:15:26.103035 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.103010 5030 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 04 07:15:26.106889 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.106869 5030 server.go:317] "Adding debug handlers to kubelet server" Nov 04 07:15:26.109263 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.109245 5030 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 04 07:15:26.109349 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.109292 5030 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 04 07:15:26.109432 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.109409 5030 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 07:09:46 +0000 UTC" deadline="2028-05-12 13:44:43.48988124 +0000 UTC" Nov 04 07:15:26.109486 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.109433 5030 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13326h29m17.380451527s" Nov 04 07:15:26.109486 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.109443 5030 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 04 07:15:26.109486 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.109455 5030 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 04 07:15:26.109620 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.109538 5030 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 04 07:15:26.110424 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:26.110400 5030 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-91.us-east-2.compute.internal\" not found" Nov 04 07:15:26.110745 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.110724 5030 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 07:15:26.111265 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.111245 5030 factory.go:55] Registering systemd factory Nov 04 07:15:26.111265 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.111267 5030 factory.go:223] Registration of the systemd container factory successfully Nov 04 07:15:26.111741 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.111720 5030 factory.go:153] Registering CRI-O factory Nov 04 07:15:26.111814 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.111745 5030 factory.go:223] Registration of the crio container factory successfully Nov 04 07:15:26.111864 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.111818 5030 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 04 07:15:26.111864 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.111836 5030 factory.go:103] Registering Raw factory Nov 04 07:15:26.111864 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.111851 5030 manager.go:1199] Started watching for new ooms in manager Nov 04 07:15:26.112307 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.112290 5030 manager.go:319] Starting recovery of all containers Nov 04 07:15:26.112828 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.112791 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e87e5256-fef7-4160-b3d9-c96d0c01641a" volumeName="kubernetes.io/projected/e87e5256-fef7-4160-b3d9-c96d0c01641a-kube-api-access-n7hld" seLinuxMountContext="" Nov 04 07:15:26.112894 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.112831 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ecfd331a-08c4-43ac-a58c-9f43935d06ed" volumeName="kubernetes.io/secret/ecfd331a-08c4-43ac-a58c-9f43935d06ed-serving-cert" seLinuxMountContext="" Nov 04 07:15:26.112894 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.112842 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f9af642-8ada-4711-b1d1-e6b086e6b16c" volumeName="kubernetes.io/secret/9f9af642-8ada-4711-b1d1-e6b086e6b16c-serving-cert" seLinuxMountContext="" Nov 04 07:15:26.112894 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.112850 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="20da56ab-0718-406e-80c4-d8fb20ac7049" volumeName="kubernetes.io/projected/20da56ab-0718-406e-80c4-d8fb20ac7049-kube-api-access-s2bsc" seLinuxMountContext="" Nov 04 07:15:26.112894 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.112860 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9084f3dd-8da4-431c-8040-1e268c3fa964" volumeName="kubernetes.io/configmap/9084f3dd-8da4-431c-8040-1e268c3fa964-ovnkube-script-lib" seLinuxMountContext="" Nov 04 07:15:26.112894 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.112878 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb" volumeName="kubernetes.io/projected/9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb-kube-api-access-6w6vl" seLinuxMountContext="" Nov 04 07:15:26.112894 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.112886 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ab2d1249-7775-4410-a8ef-8e03a4b362b9" volumeName="kubernetes.io/configmap/ab2d1249-7775-4410-a8ef-8e03a4b362b9-multus-daemon-config" seLinuxMountContext="" Nov 04 07:15:26.112894 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.112893 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fb5b977d-e13b-4499-8f7d-57b96f1b62bb" volumeName="kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-kube-api-access-mknjr" seLinuxMountContext="" Nov 04 07:15:26.113255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.112902 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="473ae29e-1292-4044-988e-293d9ae8cfe3" volumeName="kubernetes.io/projected/473ae29e-1292-4044-988e-293d9ae8cfe3-kube-api-access-99mdk" seLinuxMountContext="" Nov 04 07:15:26.113255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.112909 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5977e1b4-8c3a-42b7-8e3a-e152fd907bd4" volumeName="kubernetes.io/projected/5977e1b4-8c3a-42b7-8e3a-e152fd907bd4-kube-api-access-nh729" seLinuxMountContext="" Nov 04 07:15:26.113255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.112917 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8949591f-9c25-4e76-a673-67eb381ea2e0" volumeName="kubernetes.io/projected/8949591f-9c25-4e76-a673-67eb381ea2e0-kube-api-access-hmgtx" seLinuxMountContext="" Nov 04 07:15:26.113255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.112925 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aaff7a50-eb36-414b-a45e-5a0a56e3a8eb" volumeName="kubernetes.io/configmap/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-certificates" seLinuxMountContext="" Nov 04 07:15:26.113255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.112932 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aaff7a50-eb36-414b-a45e-5a0a56e3a8eb" volumeName="kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-kube-api-access-9tjsb" seLinuxMountContext="" Nov 04 07:15:26.113255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.112940 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f12932cd-facc-4cf2-bd45-d359ae6d6012" volumeName="kubernetes.io/projected/f12932cd-facc-4cf2-bd45-d359ae6d6012-kube-api-access-5v2qr" seLinuxMountContext="" Nov 04 07:15:26.113255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.112950 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fb5b977d-e13b-4499-8f7d-57b96f1b62bb" volumeName="kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-bound-sa-token" seLinuxMountContext="" Nov 04 07:15:26.113255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.112966 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fb5b977d-e13b-4499-8f7d-57b96f1b62bb" volumeName="kubernetes.io/secret/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-installation-pull-secrets" seLinuxMountContext="" Nov 04 07:15:26.113255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.112987 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9084f3dd-8da4-431c-8040-1e268c3fa964" volumeName="kubernetes.io/configmap/9084f3dd-8da4-431c-8040-1e268c3fa964-ovnkube-config" seLinuxMountContext="" Nov 04 07:15:26.113255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113010 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a1971526-e34c-4dd8-9c6c-b6d9d13356c1" volumeName="kubernetes.io/configmap/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-service-ca-bundle" seLinuxMountContext="" Nov 04 07:15:26.113255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113022 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a1971526-e34c-4dd8-9c6c-b6d9d13356c1" volumeName="kubernetes.io/empty-dir/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-tmp" seLinuxMountContext="" Nov 04 07:15:26.113255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113044 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a1971526-e34c-4dd8-9c6c-b6d9d13356c1" volumeName="kubernetes.io/secret/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-serving-cert" seLinuxMountContext="" Nov 04 07:15:26.113255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113058 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aaff7a50-eb36-414b-a45e-5a0a56e3a8eb" volumeName="kubernetes.io/empty-dir/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-ca-trust-extracted" seLinuxMountContext="" Nov 04 07:15:26.113255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113071 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d67d15cf-297b-4613-a63b-3c6dfa88bf8f" volumeName="kubernetes.io/projected/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-kube-api-access-zcpx4" seLinuxMountContext="" Nov 04 07:15:26.113255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113093 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dfb5c54b-81e0-4f3a-92de-ea544696ee4b" volumeName="kubernetes.io/projected/dfb5c54b-81e0-4f3a-92de-ea544696ee4b-kube-api-access-986mn" seLinuxMountContext="" Nov 04 07:15:26.113255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113107 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ecfd331a-08c4-43ac-a58c-9f43935d06ed" volumeName="kubernetes.io/configmap/ecfd331a-08c4-43ac-a58c-9f43935d06ed-trusted-ca" seLinuxMountContext="" Nov 04 07:15:26.113255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113120 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6652cbf0-521e-411b-9f75-2ce1f7c6a05b" volumeName="kubernetes.io/projected/6652cbf0-521e-411b-9f75-2ce1f7c6a05b-kube-api-access-j8v8x" seLinuxMountContext="" Nov 04 07:15:26.113255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113181 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8deda5b1-d839-4a8b-b902-8e341ffe5340" volumeName="kubernetes.io/projected/8deda5b1-d839-4a8b-b902-8e341ffe5340-kube-api-access-zsp74" seLinuxMountContext="" Nov 04 07:15:26.113255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113198 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb" volumeName="kubernetes.io/secret/9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb-serving-cert" seLinuxMountContext="" Nov 04 07:15:26.113255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113209 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f9af642-8ada-4711-b1d1-e6b086e6b16c" volumeName="kubernetes.io/projected/9f9af642-8ada-4711-b1d1-e6b086e6b16c-kube-api-access-4d8m5" seLinuxMountContext="" Nov 04 07:15:26.113255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113229 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a1971526-e34c-4dd8-9c6c-b6d9d13356c1" volumeName="kubernetes.io/empty-dir/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-snapshots" seLinuxMountContext="" Nov 04 07:15:26.113255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113241 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="042264b0-c105-41fa-89a5-fc386cb90f15" volumeName="kubernetes.io/secret/042264b0-c105-41fa-89a5-fc386cb90f15-signing-key" seLinuxMountContext="" Nov 04 07:15:26.113255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113253 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8949591f-9c25-4e76-a673-67eb381ea2e0" volumeName="kubernetes.io/configmap/8949591f-9c25-4e76-a673-67eb381ea2e0-service-ca-bundle" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113269 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b8c5588a-b014-4899-bef7-bbb6b6bfebd4" volumeName="kubernetes.io/projected/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-kube-api-access-7ndw7" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113304 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c96c91ba-0da0-4c2c-a881-e3ffffe63714" volumeName="kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-default-certificate" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113316 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d31ffcc4-d558-4eec-94c0-3a6268fca6d3" volumeName="kubernetes.io/projected/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-kube-api-access-tc8w7" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113327 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dba52b0f-ebd1-410c-b0bf-f4acc5d295dd" volumeName="kubernetes.io/configmap/dba52b0f-ebd1-410c-b0bf-f4acc5d295dd-iptables-alerter-script" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113338 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dba52b0f-ebd1-410c-b0bf-f4acc5d295dd" volumeName="kubernetes.io/projected/dba52b0f-ebd1-410c-b0bf-f4acc5d295dd-kube-api-access-xqmtc" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113350 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3ea0ef4d-2fdb-4090-965f-3db3237a4c69" volumeName="kubernetes.io/configmap/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-config" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113362 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8949591f-9c25-4e76-a673-67eb381ea2e0" volumeName="kubernetes.io/empty-dir/8949591f-9c25-4e76-a673-67eb381ea2e0-archives-path" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113373 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a1971526-e34c-4dd8-9c6c-b6d9d13356c1" volumeName="kubernetes.io/configmap/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-trusted-ca-bundle" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113385 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a1971526-e34c-4dd8-9c6c-b6d9d13356c1" volumeName="kubernetes.io/projected/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-kube-api-access-pcs6z" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113397 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d31ffcc4-d558-4eec-94c0-3a6268fca6d3" volumeName="kubernetes.io/configmap/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-whereabouts-flatfile-configmap" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113409 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d31ffcc4-d558-4eec-94c0-3a6268fca6d3" volumeName="kubernetes.io/configmap/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-cni-sysctl-allowlist" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113420 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e87e5256-fef7-4160-b3d9-c96d0c01641a" volumeName="kubernetes.io/empty-dir/e87e5256-fef7-4160-b3d9-c96d0c01641a-data-volume" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113431 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="473ae29e-1292-4044-988e-293d9ae8cfe3" volumeName="kubernetes.io/empty-dir/473ae29e-1292-4044-988e-293d9ae8cfe3-tmp-dir" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113443 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5240a510-6179-45d9-bb60-b3fc3054e304" volumeName="kubernetes.io/projected/5240a510-6179-45d9-bb60-b3fc3054e304-kube-api-access-q4fml" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113454 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6307c016-6fa4-4890-a9e5-0a0ad2f4a484" volumeName="kubernetes.io/projected/6307c016-6fa4-4890-a9e5-0a0ad2f4a484-kube-api-access-wzb6d" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113467 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="712361a9-8da4-4367-b3e9-a60bdc909482" volumeName="kubernetes.io/projected/712361a9-8da4-4367-b3e9-a60bdc909482-kube-api-access-gwmcz" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113479 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8949591f-9c25-4e76-a673-67eb381ea2e0" volumeName="kubernetes.io/configmap/8949591f-9c25-4e76-a673-67eb381ea2e0-trusted-ca-bundle" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113490 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb" volumeName="kubernetes.io/configmap/9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb-config" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113501 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ee3c09af-7a35-49ff-a0cb-4bafc08875b1" volumeName="kubernetes.io/projected/ee3c09af-7a35-49ff-a0cb-4bafc08875b1-kube-api-access-r5dxh" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113513 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f9af642-8ada-4711-b1d1-e6b086e6b16c" volumeName="kubernetes.io/configmap/9f9af642-8ada-4711-b1d1-e6b086e6b16c-config" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113524 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d67d15cf-297b-4613-a63b-3c6dfa88bf8f" volumeName="kubernetes.io/empty-dir/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-tmp" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113536 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f12932cd-facc-4cf2-bd45-d359ae6d6012" volumeName="kubernetes.io/configmap/f12932cd-facc-4cf2-bd45-d359ae6d6012-telemetry-config" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113548 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ab2d1249-7775-4410-a8ef-8e03a4b362b9" volumeName="kubernetes.io/projected/ab2d1249-7775-4410-a8ef-8e03a4b362b9-kube-api-access-629vw" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113562 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3ea0ef4d-2fdb-4090-965f-3db3237a4c69" volumeName="kubernetes.io/projected/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-kube-api-access-9vjds" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113573 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6652cbf0-521e-411b-9f75-2ce1f7c6a05b" volumeName="kubernetes.io/secret/6652cbf0-521e-411b-9f75-2ce1f7c6a05b-cert" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113593 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="706127dc-f1c4-4724-aa56-ba5c5623bcf4" volumeName="kubernetes.io/projected/706127dc-f1c4-4724-aa56-ba5c5623bcf4-kube-api-access-fctt9" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113605 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8deda5b1-d839-4a8b-b902-8e341ffe5340" volumeName="kubernetes.io/configmap/8deda5b1-d839-4a8b-b902-8e341ffe5340-config-volume" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113617 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8deda5b1-d839-4a8b-b902-8e341ffe5340" volumeName="kubernetes.io/empty-dir/8deda5b1-d839-4a8b-b902-8e341ffe5340-tmp-dir" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113630 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9084f3dd-8da4-431c-8040-1e268c3fa964" volumeName="kubernetes.io/configmap/9084f3dd-8da4-431c-8040-1e268c3fa964-env-overrides" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113644 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aaff7a50-eb36-414b-a45e-5a0a56e3a8eb" volumeName="kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-bound-sa-token" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113656 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9084f3dd-8da4-431c-8040-1e268c3fa964" volumeName="kubernetes.io/secret/9084f3dd-8da4-431c-8040-1e268c3fa964-ovn-node-metrics-cert" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113668 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9b959b9f-cdaa-46cf-9775-593ee2ee7ed5" volumeName="kubernetes.io/secret/9b959b9f-cdaa-46cf-9775-593ee2ee7ed5-agent-certs" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113679 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d31ffcc4-d558-4eec-94c0-3a6268fca6d3" volumeName="kubernetes.io/configmap/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-cni-binary-copy" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113701 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d67d15cf-297b-4613-a63b-3c6dfa88bf8f" volumeName="kubernetes.io/empty-dir/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-tuned" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113714 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ecfd331a-08c4-43ac-a58c-9f43935d06ed" volumeName="kubernetes.io/configmap/ecfd331a-08c4-43ac-a58c-9f43935d06ed-config" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113725 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ecfd331a-08c4-43ac-a58c-9f43935d06ed" volumeName="kubernetes.io/projected/ecfd331a-08c4-43ac-a58c-9f43935d06ed-kube-api-access-vqzcl" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113737 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fb5b977d-e13b-4499-8f7d-57b96f1b62bb" volumeName="kubernetes.io/secret/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-image-registry-private-configuration" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113747 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aaff7a50-eb36-414b-a45e-5a0a56e3a8eb" volumeName="kubernetes.io/configmap/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-trusted-ca" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113758 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ee3c09af-7a35-49ff-a0cb-4bafc08875b1" volumeName="kubernetes.io/configmap/ee3c09af-7a35-49ff-a0cb-4bafc08875b1-serviceca" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113772 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aaff7a50-eb36-414b-a45e-5a0a56e3a8eb" volumeName="kubernetes.io/secret/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-installation-pull-secrets" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113804 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4e036a5c-ee3f-4b8f-a173-b3b6c052bca7" volumeName="kubernetes.io/configmap/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-nginx-conf" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113819 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9084f3dd-8da4-431c-8040-1e268c3fa964" volumeName="kubernetes.io/projected/9084f3dd-8da4-431c-8040-1e268c3fa964-kube-api-access-lngkw" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113831 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9b959b9f-cdaa-46cf-9775-593ee2ee7ed5" volumeName="kubernetes.io/configmap/9b959b9f-cdaa-46cf-9775-593ee2ee7ed5-konnectivity-ca" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113844 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c96c91ba-0da0-4c2c-a881-e3ffffe63714" volumeName="kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-stats-auth" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113855 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fb5b977d-e13b-4499-8f7d-57b96f1b62bb" volumeName="kubernetes.io/configmap/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-trusted-ca" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113869 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fb5b977d-e13b-4499-8f7d-57b96f1b62bb" volumeName="kubernetes.io/empty-dir/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-ca-trust-extracted" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113881 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="042264b0-c105-41fa-89a5-fc386cb90f15" volumeName="kubernetes.io/configmap/042264b0-c105-41fa-89a5-fc386cb90f15-signing-cabundle" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113892 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07b0128a-5ba7-40f9-9f0c-fbfeae05b64e" volumeName="kubernetes.io/projected/07b0128a-5ba7-40f9-9f0c-fbfeae05b64e-kube-api-access-bfrm9" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113903 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa159b4a-95ad-4a99-ae91-995c34fc44c1" volumeName="kubernetes.io/secret/aa159b4a-95ad-4a99-ae91-995c34fc44c1-original-pull-secret" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113917 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c96c91ba-0da0-4c2c-a881-e3ffffe63714" volumeName="kubernetes.io/projected/c96c91ba-0da0-4c2c-a881-e3ffffe63714-kube-api-access-t66qf" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113929 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fb5b977d-e13b-4499-8f7d-57b96f1b62bb" volumeName="kubernetes.io/configmap/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-certificates" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113943 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="042264b0-c105-41fa-89a5-fc386cb90f15" volumeName="kubernetes.io/projected/042264b0-c105-41fa-89a5-fc386cb90f15-kube-api-access-fw5d7" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113954 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0acaaee7-9bc3-499b-ba3f-50cc5d7498fd" volumeName="kubernetes.io/projected/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd-kube-api-access-lmp9d" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113963 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aaff7a50-eb36-414b-a45e-5a0a56e3a8eb" volumeName="kubernetes.io/secret/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-image-registry-private-configuration" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113971 5030 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ab2d1249-7775-4410-a8ef-8e03a4b362b9" volumeName="kubernetes.io/configmap/ab2d1249-7775-4410-a8ef-8e03a4b362b9-cni-binary-copy" seLinuxMountContext="" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113978 5030 reconstruct.go:97] "Volume reconstruction finished" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113983 5030 reconciler.go:29] "Reconciler: start to sync state" Nov 04 07:15:26.114274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.113513 5030 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 07:15:26.116257 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.115875 5030 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 07:15:26.117184 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.117164 5030 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Nov 04 07:15:26.126000 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.125979 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-9k9rx_ecfd331a-08c4-43ac-a58c-9f43935d06ed/console-operator/1.log" Nov 04 07:15:26.128222 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.128199 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-9k9rx_ecfd331a-08c4-43ac-a58c-9f43935d06ed/console-operator/1.log" Nov 04 07:15:26.131030 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.131002 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4d9w_9084f3dd-8da4-431c-8040-1e268c3fa964/ovn-acl-logging/0.log" Nov 04 07:15:26.133544 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.133525 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4d9w_9084f3dd-8da4-431c-8040-1e268c3fa964/ovn-acl-logging/0.log" Nov 04 07:15:26.135270 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.135218 5030 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 04 07:15:26.137075 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.137053 5030 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 04 07:15:26.137075 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.137075 5030 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 04 07:15:26.137223 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.137095 5030 kubelet.go:2521] "Starting kubelet main sync loop" Nov 04 07:15:26.137223 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:26.137197 5030 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Nov 04 07:15:26.149933 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.149915 5030 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 07:15:26.151194 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.151165 5030 generic.go:356] "Generic (PLEG): container finished" podID="62932641f82fcf60f802061dd0ecb4e4" containerID="4c034ae6b059322ac45ee7c3000646801d95410ec6160a6ead049dc607a3f282" exitCode=0 Nov 04 07:15:26.159733 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.159714 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4d9w_9084f3dd-8da4-431c-8040-1e268c3fa964/ovn-acl-logging/0.log" Nov 04 07:15:26.160079 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.160060 5030 generic.go:356] "Generic (PLEG): container finished" podID="9084f3dd-8da4-431c-8040-1e268c3fa964" containerID="1e1567a8a7fb242737cd91e35a7beb64d9a55efb8030b18ce963c21d8079a719" exitCode=1 Nov 04 07:15:26.165003 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.164981 5030 generic.go:356] "Generic (PLEG): container finished" podID="d31ffcc4-d558-4eec-94c0-3a6268fca6d3" containerID="5c163600b60d135c5adad7b3236f39f04fe0d59fd198cbe6eefe36020fbdbcaa" exitCode=0 Nov 04 07:15:26.165003 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.165000 5030 generic.go:356] "Generic (PLEG): container finished" podID="d31ffcc4-d558-4eec-94c0-3a6268fca6d3" containerID="69e7c24650c439eea61b14b339f392356972e43f4498423ca3c42a207dc471b0" exitCode=0 Nov 04 07:15:26.165003 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.165007 5030 generic.go:356] "Generic (PLEG): container finished" podID="d31ffcc4-d558-4eec-94c0-3a6268fca6d3" containerID="71edae701c6304644b8e3ea293008dc5bdc8e2942fafab0af950a867f9f580ba" exitCode=0 Nov 04 07:15:26.165223 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.165012 5030 generic.go:356] "Generic (PLEG): container finished" podID="d31ffcc4-d558-4eec-94c0-3a6268fca6d3" containerID="8f18914f811199317245bc13658ae48f6fbc4cdcf51aadba935bc6d30489047e" exitCode=0 Nov 04 07:15:26.165223 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.165018 5030 generic.go:356] "Generic (PLEG): container finished" podID="d31ffcc4-d558-4eec-94c0-3a6268fca6d3" containerID="f77d16cb1e9d51e9244304fc355f978e063a9a5e5bece29ccf8fd473fa89c9f9" exitCode=0 Nov 04 07:15:26.165223 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.165025 5030 generic.go:356] "Generic (PLEG): container finished" podID="d31ffcc4-d558-4eec-94c0-3a6268fca6d3" containerID="489824c6c3844dba5df0a820841a2e0abc97164378b89a1143901f73a28cf267" exitCode=0 Nov 04 07:15:26.169502 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.169485 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-9k9rx_ecfd331a-08c4-43ac-a58c-9f43935d06ed/console-operator/1.log" Nov 04 07:15:26.169567 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.169509 5030 generic.go:356] "Generic (PLEG): container finished" podID="ecfd331a-08c4-43ac-a58c-9f43935d06ed" containerID="c6ea87867881bbc8815dc1773196ebe237577567ccdee9931a6ddaa171204b45" exitCode=255 Nov 04 07:15:26.211065 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.211018 5030 manager.go:324] Recovery completed Nov 04 07:15:26.232828 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.232807 5030 cpu_manager.go:226] "Starting" policy="none" Nov 04 07:15:26.232828 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.232823 5030 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 04 07:15:26.232988 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.232842 5030 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 04 07:15:26.233041 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.232983 5030 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Nov 04 07:15:26.233453 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.233000 5030 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Nov 04 07:15:26.233531 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.233455 5030 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Nov 04 07:15:26.233531 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.233465 5030 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Nov 04 07:15:26.233531 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.233473 5030 policy_none.go:50] "Start" Nov 04 07:15:26.233531 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.233484 5030 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 04 07:15:26.233531 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.233499 5030 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 04 07:15:26.233755 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.233689 5030 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Nov 04 07:15:26.233755 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.233701 5030 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Nov 04 07:15:26.233755 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.233709 5030 policy_none.go:44] "Start" Nov 04 07:15:26.237927 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:26.237903 5030 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Nov 04 07:15:26.238005 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.237985 5030 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 04 07:15:26.241015 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.240998 5030 manager.go:341] "Starting Device Plugin manager" Nov 04 07:15:26.241088 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:26.241026 5030 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 04 07:15:26.241088 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.241037 5030 server.go:87] "Starting device plugin registration server" Nov 04 07:15:26.241340 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.241326 5030 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 04 07:15:26.241402 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.241338 5030 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 04 07:15:26.241450 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.241425 5030 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 04 07:15:26.241573 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.241527 5030 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 04 07:15:26.241573 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.241571 5030 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 04 07:15:26.241700 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.241578 5030 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 04 07:15:26.241700 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.241630 5030 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T07:15:26.24156055Z","UUID":"1370ff92-2a57-4e57-98d4-817cad22789f","Handler":null,"Name":"","Endpoint":""} Nov 04 07:15:26.242936 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.242908 5030 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 04 07:15:26.243014 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.242944 5030 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 04 07:15:26.243079 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:26.243062 5030 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 04 07:15:26.341632 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.341609 5030 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 07:15:26.343529 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.343514 5030 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 04 07:15:26.343589 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.343540 5030 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 04 07:15:26.343589 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.343551 5030 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-91.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 04 07:15:26.343589 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.343588 5030 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:15:26.364827 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.364807 5030 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:15:26.364897 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.364861 5030 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:15:26.438800 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.438762 5030 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal"] Nov 04 07:15:26.439358 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.439327 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" event={"ID":"62932641f82fcf60f802061dd0ecb4e4","Type":"ContainerStarted","Data":"ff05403554b29d0c701410b267e1d1c2d08e19d8cd61c806a879bf6521d81bac"} Nov 04 07:15:26.439424 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.439367 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" event={"ID":"62932641f82fcf60f802061dd0ecb4e4","Type":"ContainerDied","Data":"4c034ae6b059322ac45ee7c3000646801d95410ec6160a6ead049dc607a3f282"} Nov 04 07:15:26.439424 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.439384 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" event={"ID":"62932641f82fcf60f802061dd0ecb4e4","Type":"ContainerStarted","Data":"14b30def96b8f2c9e04fae8c5c64c4de71b6a17186a15eca67789b82c7ea74f4"} Nov 04 07:15:26.439532 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.439340 5030 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:15:26.439532 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.439456 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal" event={"ID":"13dc07ab33ee08dade7a82db0cc41bf9","Type":"ContainerStarted","Data":"d8e823ab663e5a6fdf2ba94462666bc7f6833b376252ded6749d034f0126a924"} Nov 04 07:15:26.439532 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.439472 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal" event={"ID":"13dc07ab33ee08dade7a82db0cc41bf9","Type":"ContainerStarted","Data":"246bf3ef5c2f3f339c4d293e540ae9e30e0e82ef66477c7e99df996efba160c4"} Nov 04 07:15:26.439671 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.439538 5030 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:15:26.469279 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.469229 5030 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 07:15:26.469279 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:26.469273 5030 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:15:26.470944 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.470928 5030 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 07:15:26.471003 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:26.470967 5030 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:15:26.518109 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.518086 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/62932641f82fcf60f802061dd0ecb4e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal\" (UID: \"62932641f82fcf60f802061dd0ecb4e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:15:26.518197 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.518117 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62932641f82fcf60f802061dd0ecb4e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal\" (UID: \"62932641f82fcf60f802061dd0ecb4e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:15:26.518253 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.518204 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13dc07ab33ee08dade7a82db0cc41bf9-config\") pod \"kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal\" (UID: \"13dc07ab33ee08dade7a82db0cc41bf9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:15:26.618654 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.618630 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/62932641f82fcf60f802061dd0ecb4e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal\" (UID: \"62932641f82fcf60f802061dd0ecb4e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:15:26.618752 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.618663 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62932641f82fcf60f802061dd0ecb4e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal\" (UID: \"62932641f82fcf60f802061dd0ecb4e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:15:26.618752 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.618690 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13dc07ab33ee08dade7a82db0cc41bf9-config\") pod \"kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal\" (UID: \"13dc07ab33ee08dade7a82db0cc41bf9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:15:26.618752 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.618730 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/62932641f82fcf60f802061dd0ecb4e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal\" (UID: \"62932641f82fcf60f802061dd0ecb4e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:15:26.618752 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.618738 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62932641f82fcf60f802061dd0ecb4e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal\" (UID: \"62932641f82fcf60f802061dd0ecb4e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:15:26.618752 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:26.618736 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13dc07ab33ee08dade7a82db0cc41bf9-config\") pod \"kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal\" (UID: \"13dc07ab33ee08dade7a82db0cc41bf9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:15:27.093620 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.093595 5030 apiserver.go:52] "Watching apiserver" Nov 04 07:15:27.102746 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.102725 5030 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 04 07:15:27.103459 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.103435 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-kfsw5","openshift-image-registry/node-ca-p4d9h","kube-system/kas-connection-checker-685895c7c9-wzwrl","openshift-insights/periodic-gathering-twnww-hrp7j","openshift-image-registry/image-registry-67f4948c94-mmrkw","openshift-multus/multus-additional-cni-plugins-qpq6z","openshift-service-ca/service-ca-5fffc97bdf-q46x8","openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng","openshift-kube-storage-version-migrator/migrator-66df5d496b-hh854","openshift-network-console/networking-console-plugin-86c478bb88-vlsf6","openshift-ingress-canary/ingress-canary-rtcv5","openshift-multus/network-metrics-daemon-xxcn8","openshift-ovn-kubernetes/ovnkube-node-c4d9w","kube-system/kas-connection-checker-685895c7c9-smsdz","openshift-multus/multus-fschq","openshift-network-operator/iptables-alerter-v97f8","openshift-ingress/router-default-6d87c68c59-n7zhf","openshift-network-diagnostics/network-check-target-rq9pn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal","openshift-dns/node-resolver-4qdls","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8","openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw","openshift-network-diagnostics/network-check-source-6f78d59f99-9slp7","openshift-cluster-node-tuning-operator/tuned-sqzqg","openshift-console-operator/console-operator-7cd56b8dbc-9k9rx","openshift-dns/dns-default-6x2rp","openshift-insights/insights-operator-7c4986d449-p5lnr","kube-system/kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal","kube-system/konnectivity-agent-d9d49","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz","kube-system/global-pull-secret-syncer-dh9b9","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-q8mhz","openshift-kube-storage-version-migrator/migrator-66df5d496b-tlcjg","openshift-insights/insights-runtime-extractor-nx4xj","openshift-image-registry/image-registry-85f5799855-6xlbc"] Nov 04 07:15:27.105425 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.105403 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng" Nov 04 07:15:27.106357 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.106340 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" Nov 04 07:15:27.107819 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.107798 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:27.112811 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.112777 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-vlsf6" Nov 04 07:15:27.112907 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.112809 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:27.113628 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.113602 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" Nov 04 07:15:27.113718 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.113659 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 04 07:15:27.114721 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.114671 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Nov 04 07:15:27.114721 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.114759 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Nov 04 07:15:27.114920 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.114805 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Nov 04 07:15:27.115091 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.115042 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Nov 04 07:15:27.115091 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.115058 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Nov 04 07:15:27.115256 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.115147 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Nov 04 07:15:27.115424 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.115383 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Nov 04 07:15:27.115642 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.115524 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-mkgln\"" Nov 04 07:15:27.115642 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.115591 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Nov 04 07:15:27.115812 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.115796 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" Nov 04 07:15:27.116785 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.116762 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rfngn\"" Nov 04 07:15:27.116865 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.116769 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-z4qw5\"" Nov 04 07:15:27.116918 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.116877 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-x7zz4\"" Nov 04 07:15:27.116966 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.116927 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Nov 04 07:15:27.116966 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.116935 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fnvfk\"" Nov 04 07:15:27.117087 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.117061 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-z986p\"" Nov 04 07:15:27.117298 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.117276 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 04 07:15:27.117417 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.117397 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 04 07:15:27.117481 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.117470 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 04 07:15:27.117651 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.117627 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-d7v7x\"" Nov 04 07:15:27.117933 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.117916 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-twxpm\"" Nov 04 07:15:27.118045 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.118028 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Nov 04 07:15:27.118262 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.118242 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Nov 04 07:15:27.118513 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.118496 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Nov 04 07:15:27.118569 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.118555 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Nov 04 07:15:27.118749 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.118726 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" Nov 04 07:15:27.118885 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.118866 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Nov 04 07:15:27.118993 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.118894 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Nov 04 07:15:27.119055 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.119017 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Nov 04 07:15:27.119378 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.119352 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Nov 04 07:15:27.119590 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.119574 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Nov 04 07:15:27.119680 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.119662 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Nov 04 07:15:27.119731 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.119671 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Nov 04 07:15:27.120253 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.120233 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Nov 04 07:15:27.120320 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.120302 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Nov 04 07:15:27.120465 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.120444 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-jrqx8\" (UID: \"3ea0ef4d-2fdb-4090-965f-3db3237a4c69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" Nov 04 07:15:27.120532 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.120482 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vjds\" (UniqueName: \"kubernetes.io/projected/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-kube-api-access-9vjds\") pod \"cluster-samples-operator-6ddb6c8b94-jrqx8\" (UID: \"3ea0ef4d-2fdb-4090-965f-3db3237a4c69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" Nov 04 07:15:27.120532 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.120511 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-tls\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:27.120695 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.120668 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d8m5\" (UniqueName: \"kubernetes.io/projected/9f9af642-8ada-4711-b1d1-e6b086e6b16c-kube-api-access-4d8m5\") pod \"service-ca-operator-544d749c8c-qvdsw\" (UID: \"9f9af642-8ada-4711-b1d1-e6b086e6b16c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw" Nov 04 07:15:27.120789 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.120709 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-tmp\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:27.120789 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.120742 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-trusted-ca\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:27.120789 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.120768 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfrm9\" (UniqueName: \"kubernetes.io/projected/07b0128a-5ba7-40f9-9f0c-fbfeae05b64e-kube-api-access-bfrm9\") pod \"volume-data-source-validator-58c9f5f46d-q8mhz\" (UID: \"07b0128a-5ba7-40f9-9f0c-fbfeae05b64e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-q8mhz" Nov 04 07:15:27.120945 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.120843 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-tmp\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:27.120945 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.120880 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-jrqx8\" (UID: \"3ea0ef4d-2fdb-4090-965f-3db3237a4c69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" Nov 04 07:15:27.120945 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.120923 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-default-certificate\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:27.121104 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.120950 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzb6d\" (UniqueName: \"kubernetes.io/projected/6307c016-6fa4-4890-a9e5-0a0ad2f4a484-kube-api-access-wzb6d\") pod \"kas-connection-checker-685895c7c9-smsdz\" (UID: \"6307c016-6fa4-4890-a9e5-0a0ad2f4a484\") " pod="kube-system/kas-connection-checker-685895c7c9-smsdz" Nov 04 07:15:27.121104 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.120974 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-certificates\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:27.121104 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.120997 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-stats-auth\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:27.121104 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121022 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-image-registry-private-configuration\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:27.121104 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121044 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ecfd331a-08c4-43ac-a58c-9f43935d06ed-config\") pod \"console-operator-7cd56b8dbc-9k9rx\" (UID: \"ecfd331a-08c4-43ac-a58c-9f43935d06ed\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:27.121104 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121067 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ecfd331a-08c4-43ac-a58c-9f43935d06ed-trusted-ca\") pod \"console-operator-7cd56b8dbc-9k9rx\" (UID: \"ecfd331a-08c4-43ac-a58c-9f43935d06ed\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:27.121104 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121101 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f12932cd-facc-4cf2-bd45-d359ae6d6012-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-hb4ng\" (UID: \"f12932cd-facc-4cf2-bd45-d359ae6d6012\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng" Nov 04 07:15:27.121476 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121196 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-default-certificate\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:27.121476 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121248 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:27.121476 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121329 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-installation-pull-secrets\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:27.121476 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121410 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-bound-sa-token\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:27.121476 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121452 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ecfd331a-08c4-43ac-a58c-9f43935d06ed-serving-cert\") pod \"console-operator-7cd56b8dbc-9k9rx\" (UID: \"ecfd331a-08c4-43ac-a58c-9f43935d06ed\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:27.121701 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121488 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f12932cd-facc-4cf2-bd45-d359ae6d6012-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-hb4ng\" (UID: \"f12932cd-facc-4cf2-bd45-d359ae6d6012\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng" Nov 04 07:15:27.121701 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121550 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ecfd331a-08c4-43ac-a58c-9f43935d06ed-config\") pod \"console-operator-7cd56b8dbc-9k9rx\" (UID: \"ecfd331a-08c4-43ac-a58c-9f43935d06ed\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:27.121701 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121558 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-986mn\" (UniqueName: \"kubernetes.io/projected/dfb5c54b-81e0-4f3a-92de-ea544696ee4b-kube-api-access-986mn\") pod \"network-check-source-6f78d59f99-9slp7\" (UID: \"dfb5c54b-81e0-4f3a-92de-ea544696ee4b\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-9slp7" Nov 04 07:15:27.121701 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121606 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp\" (UID: \"9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp" Nov 04 07:15:27.121701 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121638 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwmcz\" (UniqueName: \"kubernetes.io/projected/712361a9-8da4-4367-b3e9-a60bdc909482-kube-api-access-gwmcz\") pod \"kas-connection-checker-685895c7c9-wzwrl\" (UID: \"712361a9-8da4-4367-b3e9-a60bdc909482\") " pod="kube-system/kas-connection-checker-685895c7c9-wzwrl" Nov 04 07:15:27.121701 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121671 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-metrics-certs\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:27.122027 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121708 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:27.122027 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121739 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-ca-trust-extracted\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:27.122027 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121764 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tjsb\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-kube-api-access-9tjsb\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:27.122027 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121793 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqzcl\" (UniqueName: \"kubernetes.io/projected/ecfd331a-08c4-43ac-a58c-9f43935d06ed-kube-api-access-vqzcl\") pod \"console-operator-7cd56b8dbc-9k9rx\" (UID: \"ecfd331a-08c4-43ac-a58c-9f43935d06ed\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:27.122027 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121818 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f9af642-8ada-4711-b1d1-e6b086e6b16c-config\") pod \"service-ca-operator-544d749c8c-qvdsw\" (UID: \"9f9af642-8ada-4711-b1d1-e6b086e6b16c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw" Nov 04 07:15:27.122027 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121842 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v2qr\" (UniqueName: \"kubernetes.io/projected/f12932cd-facc-4cf2-bd45-d359ae6d6012-kube-api-access-5v2qr\") pod \"cluster-monitoring-operator-884576c57-hb4ng\" (UID: \"f12932cd-facc-4cf2-bd45-d359ae6d6012\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng" Nov 04 07:15:27.122027 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121886 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp\" (UID: \"9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp" Nov 04 07:15:27.122027 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121898 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp\" (UID: \"9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp" Nov 04 07:15:27.122027 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121949 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t66qf\" (UniqueName: \"kubernetes.io/projected/c96c91ba-0da0-4c2c-a881-e3ffffe63714-kube-api-access-t66qf\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:27.122027 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.121984 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4fml\" (UniqueName: \"kubernetes.io/projected/5240a510-6179-45d9-bb60-b3fc3054e304-kube-api-access-q4fml\") pod \"kas-connection-checker-685895c7c9-kfsw5\" (UID: \"5240a510-6179-45d9-bb60-b3fc3054e304\") " pod="kube-system/kas-connection-checker-685895c7c9-kfsw5" Nov 04 07:15:27.122027 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.122012 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f12932cd-facc-4cf2-bd45-d359ae6d6012-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-hb4ng\" (UID: \"f12932cd-facc-4cf2-bd45-d359ae6d6012\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng" Nov 04 07:15:27.122500 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.122177 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-ca-trust-extracted\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:27.122500 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.122218 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-serving-cert\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:27.122500 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.122020 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-serving-cert\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:27.122500 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.122343 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcs6z\" (UniqueName: \"kubernetes.io/projected/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-kube-api-access-pcs6z\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:27.122500 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.122382 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w6vl\" (UniqueName: \"kubernetes.io/projected/9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb-kube-api-access-6w6vl\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp\" (UID: \"9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp" Nov 04 07:15:27.122500 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.122415 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f9af642-8ada-4711-b1d1-e6b086e6b16c-serving-cert\") pod \"service-ca-operator-544d749c8c-qvdsw\" (UID: \"9f9af642-8ada-4711-b1d1-e6b086e6b16c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw" Nov 04 07:15:27.122500 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.122445 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-snapshots\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:27.122500 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.122477 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-service-ca-bundle\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:27.122821 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.122514 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jrqx8\" (UID: \"3ea0ef4d-2fdb-4090-965f-3db3237a4c69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" Nov 04 07:15:27.122821 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.122640 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp\" (UID: \"9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp" Nov 04 07:15:27.122821 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.122760 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f9af642-8ada-4711-b1d1-e6b086e6b16c-config\") pod \"service-ca-operator-544d749c8c-qvdsw\" (UID: \"9f9af642-8ada-4711-b1d1-e6b086e6b16c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw" Nov 04 07:15:27.122944 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.122924 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f9af642-8ada-4711-b1d1-e6b086e6b16c-serving-cert\") pod \"service-ca-operator-544d749c8c-qvdsw\" (UID: \"9f9af642-8ada-4711-b1d1-e6b086e6b16c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw" Nov 04 07:15:27.122944 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.122926 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ecfd331a-08c4-43ac-a58c-9f43935d06ed-trusted-ca\") pod \"console-operator-7cd56b8dbc-9k9rx\" (UID: \"ecfd331a-08c4-43ac-a58c-9f43935d06ed\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:27.123042 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.123021 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-snapshots\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:27.123042 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.123022 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ecfd331a-08c4-43ac-a58c-9f43935d06ed-serving-cert\") pod \"console-operator-7cd56b8dbc-9k9rx\" (UID: \"ecfd331a-08c4-43ac-a58c-9f43935d06ed\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:27.123476 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.123449 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-service-ca-bundle\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:27.123648 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.123625 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:27.123902 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.123886 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:27.124862 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.124845 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:15:27.125877 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.125862 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:27.132918 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.132901 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:27.143698 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.143676 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-bound-sa-token\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:27.143773 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.143713 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v2qr\" (UniqueName: \"kubernetes.io/projected/f12932cd-facc-4cf2-bd45-d359ae6d6012-kube-api-access-5v2qr\") pod \"cluster-monitoring-operator-884576c57-hb4ng\" (UID: \"f12932cd-facc-4cf2-bd45-d359ae6d6012\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng" Nov 04 07:15:27.144697 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.144679 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4fml\" (UniqueName: \"kubernetes.io/projected/5240a510-6179-45d9-bb60-b3fc3054e304-kube-api-access-q4fml\") pod \"kas-connection-checker-685895c7c9-kfsw5\" (UID: \"5240a510-6179-45d9-bb60-b3fc3054e304\") " pod="kube-system/kas-connection-checker-685895c7c9-kfsw5" Nov 04 07:15:27.145067 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.145046 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzb6d\" (UniqueName: \"kubernetes.io/projected/6307c016-6fa4-4890-a9e5-0a0ad2f4a484-kube-api-access-wzb6d\") pod \"kas-connection-checker-685895c7c9-smsdz\" (UID: \"6307c016-6fa4-4890-a9e5-0a0ad2f4a484\") " pod="kube-system/kas-connection-checker-685895c7c9-smsdz" Nov 04 07:15:27.145487 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.145471 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqzcl\" (UniqueName: \"kubernetes.io/projected/ecfd331a-08c4-43ac-a58c-9f43935d06ed-kube-api-access-vqzcl\") pod \"console-operator-7cd56b8dbc-9k9rx\" (UID: \"ecfd331a-08c4-43ac-a58c-9f43935d06ed\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:27.145964 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.145947 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcs6z\" (UniqueName: \"kubernetes.io/projected/a1971526-e34c-4dd8-9c6c-b6d9d13356c1-kube-api-access-pcs6z\") pod \"insights-operator-7c4986d449-p5lnr\" (UID: \"a1971526-e34c-4dd8-9c6c-b6d9d13356c1\") " pod="openshift-insights/insights-operator-7c4986d449-p5lnr" Nov 04 07:15:27.149289 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.149271 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfrm9\" (UniqueName: \"kubernetes.io/projected/07b0128a-5ba7-40f9-9f0c-fbfeae05b64e-kube-api-access-bfrm9\") pod \"volume-data-source-validator-58c9f5f46d-q8mhz\" (UID: \"07b0128a-5ba7-40f9-9f0c-fbfeae05b64e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-q8mhz" Nov 04 07:15:27.149920 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.149900 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwmcz\" (UniqueName: \"kubernetes.io/projected/712361a9-8da4-4367-b3e9-a60bdc909482-kube-api-access-gwmcz\") pod \"kas-connection-checker-685895c7c9-wzwrl\" (UID: \"712361a9-8da4-4367-b3e9-a60bdc909482\") " pod="kube-system/kas-connection-checker-685895c7c9-wzwrl" Nov 04 07:15:27.150008 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.149993 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d8m5\" (UniqueName: \"kubernetes.io/projected/9f9af642-8ada-4711-b1d1-e6b086e6b16c-kube-api-access-4d8m5\") pod \"service-ca-operator-544d749c8c-qvdsw\" (UID: \"9f9af642-8ada-4711-b1d1-e6b086e6b16c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw" Nov 04 07:15:27.162570 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.162552 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 04 07:15:27.162703 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.162687 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 04 07:15:27.162779 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.162747 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 04 07:15:27.162841 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.162798 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 04 07:15:27.162919 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.162907 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 04 07:15:27.162969 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.162931 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 04 07:15:27.162969 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.162936 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Nov 04 07:15:27.163066 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.162972 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 04 07:15:27.163066 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.163051 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Nov 04 07:15:27.163194 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.163110 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 04 07:15:27.163840 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.163824 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 04 07:15:27.163931 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.163859 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Nov 04 07:15:27.163931 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.163875 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Nov 04 07:15:27.163931 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.163896 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Nov 04 07:15:27.163931 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.163922 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 04 07:15:27.164165 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.163968 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Nov 04 07:15:27.164165 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.163976 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 04 07:15:27.164165 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.164014 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Nov 04 07:15:27.164165 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.163994 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 04 07:15:27.164165 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.163999 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 04 07:15:27.164165 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.164040 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Nov 04 07:15:27.164165 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.164152 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Nov 04 07:15:27.164549 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.164190 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 04 07:15:27.164549 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.164243 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 04 07:15:27.164549 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.164127 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 04 07:15:27.164549 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.164296 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 04 07:15:27.164549 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.164320 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 04 07:15:27.164549 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.164341 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 04 07:15:27.164549 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.164382 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 04 07:15:27.164549 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.164409 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 04 07:15:27.164549 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.164505 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 04 07:15:27.164549 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.164517 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 04 07:15:27.164549 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.164507 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 04 07:15:27.165107 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.164607 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 04 07:15:27.165107 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.164611 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 04 07:15:27.165107 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.164698 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 04 07:15:27.165107 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.164733 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Nov 04 07:15:27.165107 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.164733 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Nov 04 07:15:27.165107 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.164876 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 04 07:15:27.165466 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.165449 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t66qf\" (UniqueName: \"kubernetes.io/projected/c96c91ba-0da0-4c2c-a881-e3ffffe63714-kube-api-access-t66qf\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:27.165858 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.165836 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w6vl\" (UniqueName: \"kubernetes.io/projected/9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb-kube-api-access-6w6vl\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp\" (UID: \"9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp" Nov 04 07:15:27.166078 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.166039 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 04 07:15:27.166171 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.166107 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-986mn\" (UniqueName: \"kubernetes.io/projected/dfb5c54b-81e0-4f3a-92de-ea544696ee4b-kube-api-access-986mn\") pod \"network-check-source-6f78d59f99-9slp7\" (UID: \"dfb5c54b-81e0-4f3a-92de-ea544696ee4b\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-9slp7" Nov 04 07:15:27.166171 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.166147 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 04 07:15:27.166243 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.166174 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vjds\" (UniqueName: \"kubernetes.io/projected/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-kube-api-access-9vjds\") pod \"cluster-samples-operator-6ddb6c8b94-jrqx8\" (UID: \"3ea0ef4d-2fdb-4090-965f-3db3237a4c69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" Nov 04 07:15:27.166243 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.166238 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Nov 04 07:15:27.169384 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.169362 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tjsb\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-kube-api-access-9tjsb\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:27.171230 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.171210 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-trusted-ca\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:27.171230 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.171220 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-certificates\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:27.200452 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.200434 5030 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:15:27.200576 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.200562 5030 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:15:27.210807 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.210789 5030 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 04 07:15:27.212831 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.212819 5030 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 07:15:27.212878 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:27.212853 5030 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:15:27.214761 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.214745 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Nov 04 07:15:27.215011 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.214998 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Nov 04 07:15:27.215083 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.214999 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 04 07:15:27.215083 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.215035 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Nov 04 07:15:27.215224 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.215201 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 04 07:15:27.215674 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.215659 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mslv7\"" Nov 04 07:15:27.215831 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.215816 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Nov 04 07:15:27.215903 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.215839 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-mbbzm\"" Nov 04 07:15:27.215903 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.215838 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p5dks\"" Nov 04 07:15:27.215903 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.215858 5030 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 07:15:27.216019 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:27.215938 5030 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.us-east-2.compute.internal" Nov 04 07:15:27.216176 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216159 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 04 07:15:27.216211 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216176 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9lks7\"" Nov 04 07:15:27.216211 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216205 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 04 07:15:27.216276 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216221 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 04 07:15:27.216276 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216226 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tqngx\"" Nov 04 07:15:27.216276 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216250 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-hvg8n\"" Nov 04 07:15:27.216276 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216273 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-slv86\"" Nov 04 07:15:27.216444 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216275 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 04 07:15:27.216444 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216306 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-tjts4\"" Nov 04 07:15:27.216444 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216319 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-zw52p\"" Nov 04 07:15:27.216444 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216333 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-8kctk\"" Nov 04 07:15:27.216444 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216334 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 04 07:15:27.216444 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216345 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ltv7r\"" Nov 04 07:15:27.216444 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216334 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-h4sd8\"" Nov 04 07:15:27.216444 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216361 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Nov 04 07:15:27.216444 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216372 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8bggl\"" Nov 04 07:15:27.216444 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216394 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Nov 04 07:15:27.216806 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216606 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Nov 04 07:15:27.216806 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216614 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l4l9x\"" Nov 04 07:15:27.216806 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216639 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gcxz6\"" Nov 04 07:15:27.216806 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216664 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-7rfcz\"" Nov 04 07:15:27.216806 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216673 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5h9h4\"" Nov 04 07:15:27.216806 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216690 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6pjn4\"" Nov 04 07:15:27.216806 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216693 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gnthh\"" Nov 04 07:15:27.217023 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216819 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 04 07:15:27.217023 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.216848 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7qf26\"" Nov 04 07:15:27.222282 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.222267 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-installation-pull-secrets\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:27.222282 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.222276 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-stats-auth\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:27.222371 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.222351 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-image-registry-private-configuration\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:27.223494 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.223480 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7hld\" (UniqueName: \"kubernetes.io/projected/e87e5256-fef7-4160-b3d9-c96d0c01641a-kube-api-access-n7hld\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:27.223532 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.223502 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-cni-binary-copy\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:15:27.223532 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.223518 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:15:27.223635 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.223532 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-tls\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:27.223635 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.223548 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aa159b4a-95ad-4a99-ae91-995c34fc44c1-dbus\") pod \"global-pull-secret-syncer-dh9b9\" (UID: \"aa159b4a-95ad-4a99-ae91-995c34fc44c1\") " pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:15:27.223728 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.223668 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-system-cni-dir\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:15:27.223728 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.223718 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-sysctl-conf\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.223819 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.223748 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-run\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.223819 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.223790 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-etc-openvswitch\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.223915 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.223817 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lngkw\" (UniqueName: \"kubernetes.io/projected/9084f3dd-8da4-431c-8040-1e268c3fa964-kube-api-access-lngkw\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.223915 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.223853 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e87e5256-fef7-4160-b3d9-c96d0c01641a-crio-socket\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:27.223915 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.223874 5030 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 04 07:15:27.223915 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.223898 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:15:27.224080 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.223931 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-cni-binary-copy\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:15:27.224080 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.223959 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-system-cni-dir\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.224080 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.223995 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-run-netns\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.224080 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.224024 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-var-lib-cni-bin\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.224080 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.224048 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/042264b0-c105-41fa-89a5-fc386cb90f15-signing-cabundle\") pod \"service-ca-5fffc97bdf-q46x8\" (UID: \"042264b0-c105-41fa-89a5-fc386cb90f15\") " pod="openshift-service-ca/service-ca-5fffc97bdf-q46x8" Nov 04 07:15:27.224521 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.224493 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-vlsf6\" (UID: \"4e036a5c-ee3f-4b8f-a173-b3b6c052bca7\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-vlsf6" Nov 04 07:15:27.224618 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.224544 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-var-lib-kubelet\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.224618 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.224595 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:15:27.224732 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.224631 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/042264b0-c105-41fa-89a5-fc386cb90f15-signing-cabundle\") pod \"service-ca-5fffc97bdf-q46x8\" (UID: \"042264b0-c105-41fa-89a5-fc386cb90f15\") " pod="openshift-service-ca/service-ca-5fffc97bdf-q46x8" Nov 04 07:15:27.224732 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.224654 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-bound-sa-token\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:27.224732 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.224716 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f12932cd-facc-4cf2-bd45-d359ae6d6012-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-hb4ng\" (UID: \"f12932cd-facc-4cf2-bd45-d359ae6d6012\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng" Nov 04 07:15:27.224877 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.224749 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs\") pod \"network-metrics-daemon-xxcn8\" (UID: \"706127dc-f1c4-4724-aa56-ba5c5623bcf4\") " pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:15:27.225009 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.224987 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-run-netns\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.226095 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.225067 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-run-openvswitch\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.226095 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.225102 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-629vw\" (UniqueName: \"kubernetes.io/projected/ab2d1249-7775-4410-a8ef-8e03a4b362b9-kube-api-access-629vw\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.226095 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.225151 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-systemd\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.226095 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.225206 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-metrics-certs\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:27.226095 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.225243 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aa159b4a-95ad-4a99-ae91-995c34fc44c1-kubelet-config\") pod \"global-pull-secret-syncer-dh9b9\" (UID: \"aa159b4a-95ad-4a99-ae91-995c34fc44c1\") " pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:15:27.226095 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.225269 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-run-ovn-kubernetes\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.226095 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.225303 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8v8x\" (UniqueName: \"kubernetes.io/projected/6652cbf0-521e-411b-9f75-2ce1f7c6a05b-kube-api-access-j8v8x\") pod \"ingress-canary-rtcv5\" (UID: \"6652cbf0-521e-411b-9f75-2ce1f7c6a05b\") " pod="openshift-ingress-canary/ingress-canary-rtcv5" Nov 04 07:15:27.226095 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.225335 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-run-multus-certs\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.226095 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.225365 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/473ae29e-1292-4044-988e-293d9ae8cfe3-hosts-file\") pod \"node-resolver-4qdls\" (UID: \"473ae29e-1292-4044-988e-293d9ae8cfe3\") " pod="openshift-dns/node-resolver-4qdls" Nov 04 07:15:27.226095 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.225403 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dba52b0f-ebd1-410c-b0bf-f4acc5d295dd-iptables-alerter-script\") pod \"iptables-alerter-v97f8\" (UID: \"dba52b0f-ebd1-410c-b0bf-f4acc5d295dd\") " pod="openshift-network-operator/iptables-alerter-v97f8" Nov 04 07:15:27.226095 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.225432 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqmtc\" (UniqueName: \"kubernetes.io/projected/dba52b0f-ebd1-410c-b0bf-f4acc5d295dd-kube-api-access-xqmtc\") pod \"iptables-alerter-v97f8\" (UID: \"dba52b0f-ebd1-410c-b0bf-f4acc5d295dd\") " pod="openshift-network-operator/iptables-alerter-v97f8" Nov 04 07:15:27.226095 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.225492 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-cnibin\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:15:27.226095 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.225526 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:15:27.226095 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.225558 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-sysctl-d\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.226821 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.226229 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dba52b0f-ebd1-410c-b0bf-f4acc5d295dd-iptables-alerter-script\") pod \"iptables-alerter-v97f8\" (UID: \"dba52b0f-ebd1-410c-b0bf-f4acc5d295dd\") " pod="openshift-network-operator/iptables-alerter-v97f8" Nov 04 07:15:27.226932 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.226911 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8949591f-9c25-4e76-a673-67eb381ea2e0-service-ca-bundle\") pod \"periodic-gathering-twnww-hrp7j\" (UID: \"8949591f-9c25-4e76-a673-67eb381ea2e0\") " pod="openshift-insights/periodic-gathering-twnww-hrp7j" Nov 04 07:15:27.226987 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.226959 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-tls\") pod \"image-registry-67f4948c94-mmrkw\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.228294 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8949591f-9c25-4e76-a673-67eb381ea2e0-service-ca-bundle\") pod \"periodic-gathering-twnww-hrp7j\" (UID: \"8949591f-9c25-4e76-a673-67eb381ea2e0\") " pod="openshift-insights/periodic-gathering-twnww-hrp7j" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.228343 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab2d1249-7775-4410-a8ef-8e03a4b362b9-cni-binary-copy\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.228376 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-multus-socket-dir-parent\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.228405 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-var-lib-kubelet\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.228435 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-modprobe-d\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.228467 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ndw7\" (UniqueName: \"kubernetes.io/projected/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-kube-api-access-7ndw7\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.228497 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jrqx8\" (UID: \"3ea0ef4d-2fdb-4090-965f-3db3237a4c69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.228530 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw5d7\" (UniqueName: \"kubernetes.io/projected/042264b0-c105-41fa-89a5-fc386cb90f15-kube-api-access-fw5d7\") pod \"service-ca-5fffc97bdf-q46x8\" (UID: \"042264b0-c105-41fa-89a5-fc386cb90f15\") " pod="openshift-service-ca/service-ca-5fffc97bdf-q46x8" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.228812 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab2d1249-7775-4410-a8ef-8e03a4b362b9-cni-binary-copy\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.228957 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c96c91ba-0da0-4c2c-a881-e3ffffe63714-metrics-certs\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.229039 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2bsc\" (UniqueName: \"kubernetes.io/projected/20da56ab-0718-406e-80c4-d8fb20ac7049-kube-api-access-s2bsc\") pod \"migrator-66df5d496b-tlcjg\" (UID: \"20da56ab-0718-406e-80c4-d8fb20ac7049\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-tlcjg" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.229086 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.229128 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mknjr\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-kube-api-access-mknjr\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.229216 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee3c09af-7a35-49ff-a0cb-4bafc08875b1-host\") pod \"node-ca-p4d9h\" (UID: \"ee3c09af-7a35-49ff-a0cb-4bafc08875b1\") " pod="openshift-image-registry/node-ca-p4d9h" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.229242 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee3c09af-7a35-49ff-a0cb-4bafc08875b1-serviceca\") pod \"node-ca-p4d9h\" (UID: \"ee3c09af-7a35-49ff-a0cb-4bafc08875b1\") " pod="openshift-image-registry/node-ca-p4d9h" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.229273 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-log-socket\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.229304 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9084f3dd-8da4-431c-8040-1e268c3fa964-env-overrides\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.229336 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e87e5256-fef7-4160-b3d9-c96d0c01641a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.229365 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-hostroot\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.229400 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcpx4\" (UniqueName: \"kubernetes.io/projected/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-kube-api-access-zcpx4\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.229432 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-cni-bin\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.229548 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-run-systemd\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.229590 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc8w7\" (UniqueName: \"kubernetes.io/projected/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-kube-api-access-tc8w7\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.229678 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6652cbf0-521e-411b-9f75-2ce1f7c6a05b-cert\") pod \"ingress-canary-rtcv5\" (UID: \"6652cbf0-521e-411b-9f75-2ce1f7c6a05b\") " pod="openshift-ingress-canary/ingress-canary-rtcv5" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.229712 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-nginx-conf\") pod \"networking-console-plugin-86c478bb88-vlsf6\" (UID: \"4e036a5c-ee3f-4b8f-a173-b3b6c052bca7\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-vlsf6" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.229789 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh729\" (UniqueName: \"kubernetes.io/projected/5977e1b4-8c3a-42b7-8e3a-e152fd907bd4-kube-api-access-nh729\") pod \"migrator-66df5d496b-hh854\" (UID: \"5977e1b4-8c3a-42b7-8e3a-e152fd907bd4\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hh854" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.229825 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8deda5b1-d839-4a8b-b902-8e341ffe5340-tmp-dir\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.229859 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab2d1249-7775-4410-a8ef-8e03a4b362b9-multus-daemon-config\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.230086 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8deda5b1-d839-4a8b-b902-8e341ffe5340-tmp-dir\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.230146 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-nginx-conf\") pod \"networking-console-plugin-86c478bb88-vlsf6\" (UID: \"4e036a5c-ee3f-4b8f-a173-b3b6c052bca7\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-vlsf6" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.230260 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee3c09af-7a35-49ff-a0cb-4bafc08875b1-serviceca\") pod \"node-ca-p4d9h\" (UID: \"ee3c09af-7a35-49ff-a0cb-4bafc08875b1\") " pod="openshift-image-registry/node-ca-p4d9h" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.230313 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-etc-kubernetes\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.230348 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9084f3dd-8da4-431c-8040-1e268c3fa964-env-overrides\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.230357 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-image-registry-private-configuration\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.230365 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6652cbf0-521e-411b-9f75-2ce1f7c6a05b-cert\") pod \"ingress-canary-rtcv5\" (UID: \"6652cbf0-521e-411b-9f75-2ce1f7c6a05b\") " pod="openshift-ingress-canary/ingress-canary-rtcv5" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.230401 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/8949591f-9c25-4e76-a673-67eb381ea2e0-archives-path\") pod \"periodic-gathering-twnww-hrp7j\" (UID: \"8949591f-9c25-4e76-a673-67eb381ea2e0\") " pod="openshift-insights/periodic-gathering-twnww-hrp7j" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.230475 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-sys-fs\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.230508 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/8949591f-9c25-4e76-a673-67eb381ea2e0-archives-path\") pod \"periodic-gathering-twnww-hrp7j\" (UID: \"8949591f-9c25-4e76-a673-67eb381ea2e0\") " pod="openshift-insights/periodic-gathering-twnww-hrp7j" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.230614 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-tls\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.230651 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-certificates\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.230687 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-installation-pull-secrets\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.230791 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8deda5b1-d839-4a8b-b902-8e341ffe5340-metrics-tls\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.230973 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8949591f-9c25-4e76-a673-67eb381ea2e0-trusted-ca-bundle\") pod \"periodic-gathering-twnww-hrp7j\" (UID: \"8949591f-9c25-4e76-a673-67eb381ea2e0\") " pod="openshift-insights/periodic-gathering-twnww-hrp7j" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.230995 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-installation-pull-secrets\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.231008 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99mdk\" (UniqueName: \"kubernetes.io/projected/473ae29e-1292-4044-988e-293d9ae8cfe3-kube-api-access-99mdk\") pod \"node-resolver-4qdls\" (UID: \"473ae29e-1292-4044-988e-293d9ae8cfe3\") " pod="openshift-dns/node-resolver-4qdls" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.231051 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab2d1249-7775-4410-a8ef-8e03a4b362b9-multus-daemon-config\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.231087 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-certificates\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.230910 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-image-registry-private-configuration\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.231086 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9084f3dd-8da4-431c-8040-1e268c3fa964-ovnkube-config\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.231165 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-sys\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.231308 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-tmp\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.231365 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9084f3dd-8da4-431c-8040-1e268c3fa964-ovnkube-config\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.231479 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ea0ef4d-2fdb-4090-965f-3db3237a4c69-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jrqx8\" (UID: \"3ea0ef4d-2fdb-4090-965f-3db3237a4c69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.231483 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-run-ovn\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.231497 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-tmp\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.231534 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-node-log\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.231574 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.231648 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-trusted-ca\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.231663 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8949591f-9c25-4e76-a673-67eb381ea2e0-trusted-ca-bundle\") pod \"periodic-gathering-twnww-hrp7j\" (UID: \"8949591f-9c25-4e76-a673-67eb381ea2e0\") " pod="openshift-insights/periodic-gathering-twnww-hrp7j" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232056 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232120 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dba52b0f-ebd1-410c-b0bf-f4acc5d295dd-host-slash\") pod \"iptables-alerter-v97f8\" (UID: \"dba52b0f-ebd1-410c-b0bf-f4acc5d295dd\") " pod="openshift-network-operator/iptables-alerter-v97f8" Nov 04 07:15:27.232157 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:27.232212 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle podName:c96c91ba-0da0-4c2c-a881-e3ffffe63714 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:27.732196094 +0000 UTC m=+1.714824263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle") pod "router-default-6d87c68c59-n7zhf" (UID: "c96c91ba-0da0-4c2c-a881-e3ffffe63714") : configmap references non-existent config key: service-ca.crt Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232367 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9084f3dd-8da4-431c-8040-1e268c3fa964-ovnkube-script-lib\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232399 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-host\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232416 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-tuned\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232418 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-trusted-ca\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232458 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-slash\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232473 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-etc-selinux\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232481 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f12932cd-facc-4cf2-bd45-d359ae6d6012-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-hb4ng\" (UID: \"f12932cd-facc-4cf2-bd45-d359ae6d6012\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232494 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-var-lib-openvswitch\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232520 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/042264b0-c105-41fa-89a5-fc386cb90f15-signing-key\") pod \"service-ca-5fffc97bdf-q46x8\" (UID: \"042264b0-c105-41fa-89a5-fc386cb90f15\") " pod="openshift-service-ca/service-ca-5fffc97bdf-q46x8" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232545 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fctt9\" (UniqueName: \"kubernetes.io/projected/706127dc-f1c4-4724-aa56-ba5c5623bcf4-kube-api-access-fctt9\") pod \"network-metrics-daemon-xxcn8\" (UID: \"706127dc-f1c4-4724-aa56-ba5c5623bcf4\") " pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232561 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-systemd-units\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232575 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-run-k8s-cni-cncf-io\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232631 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9084f3dd-8da4-431c-8040-1e268c3fa964-ovnkube-script-lib\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232668 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-tuned\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232728 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/042264b0-c105-41fa-89a5-fc386cb90f15-signing-key\") pod \"service-ca-5fffc97bdf-q46x8\" (UID: \"042264b0-c105-41fa-89a5-fc386cb90f15\") " pod="openshift-service-ca/service-ca-5fffc97bdf-q46x8" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232728 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-cni-netd\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232761 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-sysconfig\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232784 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-lib-modules\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232800 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-socket-dir\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232824 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-device-dir\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232842 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-ca-trust-extracted\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232875 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b959b9f-cdaa-46cf-9775-593ee2ee7ed5-konnectivity-ca\") pod \"konnectivity-agent-d9d49\" (UID: \"9b959b9f-cdaa-46cf-9775-593ee2ee7ed5\") " pod="kube-system/konnectivity-agent-d9d49" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232891 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-var-lib-cni-multus\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232922 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-multus-conf-dir\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232940 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmgtx\" (UniqueName: \"kubernetes.io/projected/8949591f-9c25-4e76-a673-67eb381ea2e0-kube-api-access-hmgtx\") pod \"periodic-gathering-twnww-hrp7j\" (UID: \"8949591f-9c25-4e76-a673-67eb381ea2e0\") " pod="openshift-insights/periodic-gathering-twnww-hrp7j" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232970 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/473ae29e-1292-4044-988e-293d9ae8cfe3-tmp-dir\") pod \"node-resolver-4qdls\" (UID: \"473ae29e-1292-4044-988e-293d9ae8cfe3\") " pod="openshift-dns/node-resolver-4qdls" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.232987 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b959b9f-cdaa-46cf-9775-593ee2ee7ed5-agent-certs\") pod \"konnectivity-agent-d9d49\" (UID: \"9b959b9f-cdaa-46cf-9775-593ee2ee7ed5\") " pod="kube-system/konnectivity-agent-d9d49" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.233001 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-cnibin\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.233025 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b959b9f-cdaa-46cf-9775-593ee2ee7ed5-konnectivity-ca\") pod \"konnectivity-agent-d9d49\" (UID: \"9b959b9f-cdaa-46cf-9775-593ee2ee7ed5\") " pod="kube-system/konnectivity-agent-d9d49" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.233033 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-kubernetes\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.233051 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmp9d\" (UniqueName: \"kubernetes.io/projected/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd-kube-api-access-lmp9d\") pod \"network-check-target-rq9pn\" (UID: \"0acaaee7-9bc3-499b-ba3f-50cc5d7498fd\") " pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.233066 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-ca-trust-extracted\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.233067 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-kubelet\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.233098 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsp74\" (UniqueName: \"kubernetes.io/projected/8deda5b1-d839-4a8b-b902-8e341ffe5340-kube-api-access-zsp74\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.233116 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9084f3dd-8da4-431c-8040-1e268c3fa964-ovn-node-metrics-cert\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.233155 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/473ae29e-1292-4044-988e-293d9ae8cfe3-tmp-dir\") pod \"node-resolver-4qdls\" (UID: \"473ae29e-1292-4044-988e-293d9ae8cfe3\") " pod="openshift-dns/node-resolver-4qdls" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.233188 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8deda5b1-d839-4a8b-b902-8e341ffe5340-config-volume\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.233213 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e87e5256-fef7-4160-b3d9-c96d0c01641a-data-volume\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.233237 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.233253 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-registration-dir\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.233268 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa159b4a-95ad-4a99-ae91-995c34fc44c1-original-pull-secret\") pod \"global-pull-secret-syncer-dh9b9\" (UID: \"aa159b4a-95ad-4a99-ae91-995c34fc44c1\") " pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.233373 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5dxh\" (UniqueName: \"kubernetes.io/projected/ee3c09af-7a35-49ff-a0cb-4bafc08875b1-kube-api-access-r5dxh\") pod \"node-ca-p4d9h\" (UID: \"ee3c09af-7a35-49ff-a0cb-4bafc08875b1\") " pod="openshift-image-registry/node-ca-p4d9h" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.233389 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-multus-cni-dir\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.233512 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8deda5b1-d839-4a8b-b902-8e341ffe5340-config-volume\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.233567 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e87e5256-fef7-4160-b3d9-c96d0c01641a-data-volume\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.233592 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b959b9f-cdaa-46cf-9775-593ee2ee7ed5-agent-certs\") pod \"konnectivity-agent-d9d49\" (UID: \"9b959b9f-cdaa-46cf-9775-593ee2ee7ed5\") " pod="kube-system/konnectivity-agent-d9d49" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.233684 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.233690 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9084f3dd-8da4-431c-8040-1e268c3fa964-ovn-node-metrics-cert\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.234086 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa159b4a-95ad-4a99-ae91-995c34fc44c1-original-pull-secret\") pod \"global-pull-secret-syncer-dh9b9\" (UID: \"aa159b4a-95ad-4a99-ae91-995c34fc44c1\") " pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:15:27.235295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.234416 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7hld\" (UniqueName: \"kubernetes.io/projected/e87e5256-fef7-4160-b3d9-c96d0c01641a-kube-api-access-n7hld\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:27.251109 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.251083 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-bound-sa-token\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:27.251315 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.251300 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lngkw\" (UniqueName: \"kubernetes.io/projected/9084f3dd-8da4-431c-8040-1e268c3fa964-kube-api-access-lngkw\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.254631 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.254615 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw5d7\" (UniqueName: \"kubernetes.io/projected/042264b0-c105-41fa-89a5-fc386cb90f15-kube-api-access-fw5d7\") pod \"service-ca-5fffc97bdf-q46x8\" (UID: \"042264b0-c105-41fa-89a5-fc386cb90f15\") " pod="openshift-service-ca/service-ca-5fffc97bdf-q46x8" Nov 04 07:15:27.254689 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.254661 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mknjr\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-kube-api-access-mknjr\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:27.255591 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.255575 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsp74\" (UniqueName: \"kubernetes.io/projected/8deda5b1-d839-4a8b-b902-8e341ffe5340-kube-api-access-zsp74\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:27.255713 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.255698 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5dxh\" (UniqueName: \"kubernetes.io/projected/ee3c09af-7a35-49ff-a0cb-4bafc08875b1-kube-api-access-r5dxh\") pod \"node-ca-p4d9h\" (UID: \"ee3c09af-7a35-49ff-a0cb-4bafc08875b1\") " pod="openshift-image-registry/node-ca-p4d9h" Nov 04 07:15:27.255753 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.255718 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99mdk\" (UniqueName: \"kubernetes.io/projected/473ae29e-1292-4044-988e-293d9ae8cfe3-kube-api-access-99mdk\") pod \"node-resolver-4qdls\" (UID: \"473ae29e-1292-4044-988e-293d9ae8cfe3\") " pod="openshift-dns/node-resolver-4qdls" Nov 04 07:15:27.256304 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.256287 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fctt9\" (UniqueName: \"kubernetes.io/projected/706127dc-f1c4-4724-aa56-ba5c5623bcf4-kube-api-access-fctt9\") pod \"network-metrics-daemon-xxcn8\" (UID: \"706127dc-f1c4-4724-aa56-ba5c5623bcf4\") " pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:15:27.256619 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.256603 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqmtc\" (UniqueName: \"kubernetes.io/projected/dba52b0f-ebd1-410c-b0bf-f4acc5d295dd-kube-api-access-xqmtc\") pod \"iptables-alerter-v97f8\" (UID: \"dba52b0f-ebd1-410c-b0bf-f4acc5d295dd\") " pod="openshift-network-operator/iptables-alerter-v97f8" Nov 04 07:15:27.257822 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.257807 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-629vw\" (UniqueName: \"kubernetes.io/projected/ab2d1249-7775-4410-a8ef-8e03a4b362b9-kube-api-access-629vw\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.258092 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.258076 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcpx4\" (UniqueName: \"kubernetes.io/projected/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-kube-api-access-zcpx4\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.258282 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.258261 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ndw7\" (UniqueName: \"kubernetes.io/projected/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-kube-api-access-7ndw7\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:15:27.258417 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.258404 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmp9d\" (UniqueName: \"kubernetes.io/projected/0acaaee7-9bc3-499b-ba3f-50cc5d7498fd-kube-api-access-lmp9d\") pod \"network-check-target-rq9pn\" (UID: \"0acaaee7-9bc3-499b-ba3f-50cc5d7498fd\") " pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:15:27.259586 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.259556 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc8w7\" (UniqueName: \"kubernetes.io/projected/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-kube-api-access-tc8w7\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:15:27.259666 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.259597 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2bsc\" (UniqueName: \"kubernetes.io/projected/20da56ab-0718-406e-80c4-d8fb20ac7049-kube-api-access-s2bsc\") pod \"migrator-66df5d496b-tlcjg\" (UID: \"20da56ab-0718-406e-80c4-d8fb20ac7049\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-tlcjg" Nov 04 07:15:27.259666 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.259647 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8v8x\" (UniqueName: \"kubernetes.io/projected/6652cbf0-521e-411b-9f75-2ce1f7c6a05b-kube-api-access-j8v8x\") pod \"ingress-canary-rtcv5\" (UID: \"6652cbf0-521e-411b-9f75-2ce1f7c6a05b\") " pod="openshift-ingress-canary/ingress-canary-rtcv5" Nov 04 07:15:27.259865 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.259850 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh729\" (UniqueName: \"kubernetes.io/projected/5977e1b4-8c3a-42b7-8e3a-e152fd907bd4-kube-api-access-nh729\") pod \"migrator-66df5d496b-hh854\" (UID: \"5977e1b4-8c3a-42b7-8e3a-e152fd907bd4\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hh854" Nov 04 07:15:27.259906 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.259863 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmgtx\" (UniqueName: \"kubernetes.io/projected/8949591f-9c25-4e76-a673-67eb381ea2e0-kube-api-access-hmgtx\") pod \"periodic-gathering-twnww-hrp7j\" (UID: \"8949591f-9c25-4e76-a673-67eb381ea2e0\") " pod="openshift-insights/periodic-gathering-twnww-hrp7j" Nov 04 07:15:27.323583 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.323559 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rtcv5_6652cbf0-521e-411b-9f75-2ce1f7c6a05b/serve-healthcheck-canary/0.log" Nov 04 07:15:27.334190 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334168 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-cni-bin\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.334273 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334197 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-run-systemd\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.334273 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334223 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-etc-kubernetes\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.334273 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334238 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-sys-fs\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:15:27.334273 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334269 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-tls\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:27.334423 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334283 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-cni-bin\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.334423 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334301 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-etc-kubernetes\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.334423 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334320 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-sys-fs\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:15:27.334423 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334283 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-run-systemd\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.334423 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334288 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8deda5b1-d839-4a8b-b902-8e341ffe5340-metrics-tls\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:27.334423 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:27.334360 5030 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 07:15:27.334423 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334372 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-sys\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.334423 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334402 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-sys\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.334423 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:27.334413 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8deda5b1-d839-4a8b-b902-8e341ffe5340-metrics-tls podName:8deda5b1-d839-4a8b-b902-8e341ffe5340 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:27.834401807 +0000 UTC m=+1.817029977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8deda5b1-d839-4a8b-b902-8e341ffe5340-metrics-tls") pod "dns-default-6x2rp" (UID: "8deda5b1-d839-4a8b-b902-8e341ffe5340") : secret "dns-default-metrics-tls" not found Nov 04 07:15:27.334817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334437 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-run-ovn\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.334817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334455 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-node-log\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.334817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334470 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.334817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334500 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-run-ovn\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.334817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334522 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.334817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334520 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-node-log\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.334817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334535 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dba52b0f-ebd1-410c-b0bf-f4acc5d295dd-host-slash\") pod \"iptables-alerter-v97f8\" (UID: \"dba52b0f-ebd1-410c-b0bf-f4acc5d295dd\") " pod="openshift-network-operator/iptables-alerter-v97f8" Nov 04 07:15:27.334817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334559 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dba52b0f-ebd1-410c-b0bf-f4acc5d295dd-host-slash\") pod \"iptables-alerter-v97f8\" (UID: \"dba52b0f-ebd1-410c-b0bf-f4acc5d295dd\") " pod="openshift-network-operator/iptables-alerter-v97f8" Nov 04 07:15:27.334817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334578 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-host\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.334817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334604 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-slash\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.334817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334628 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-etc-selinux\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:15:27.334817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334644 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-host\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.334817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334655 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-slash\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.334817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334655 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-var-lib-openvswitch\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.334817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334691 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-var-lib-openvswitch\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.334817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334697 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-systemd-units\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.334817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334696 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-etc-selinux\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:15:27.334817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334728 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-systemd-units\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.334817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334727 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-run-k8s-cni-cncf-io\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.334817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334754 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-run-k8s-cni-cncf-io\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.334817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334758 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-cni-netd\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.334817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334780 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-sysconfig\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.334817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334802 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-lib-modules\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.334817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334824 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-socket-dir\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334846 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-device-dir\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334854 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-sysconfig\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334872 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-var-lib-cni-multus\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334887 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-cni-netd\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334895 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-multus-conf-dir\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334906 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-lib-modules\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334921 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-cnibin\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334931 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-var-lib-cni-multus\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334943 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-kubernetes\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334950 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-cnibin\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334947 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-multus-conf-dir\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334972 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-socket-dir\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334983 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-kubelet\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.334922 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-device-dir\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335026 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-kubernetes\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335025 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-registration-dir\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335032 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-kubelet\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335052 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-multus-cni-dir\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335050 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-registration-dir\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335075 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aa159b4a-95ad-4a99-ae91-995c34fc44c1-dbus\") pod \"global-pull-secret-syncer-dh9b9\" (UID: \"aa159b4a-95ad-4a99-ae91-995c34fc44c1\") " pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335111 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-system-cni-dir\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335153 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-sysctl-conf\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335164 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aa159b4a-95ad-4a99-ae91-995c34fc44c1-dbus\") pod \"global-pull-secret-syncer-dh9b9\" (UID: \"aa159b4a-95ad-4a99-ae91-995c34fc44c1\") " pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335177 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-run\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335185 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-system-cni-dir\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335152 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-multus-cni-dir\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335202 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-etc-openvswitch\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335223 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e87e5256-fef7-4160-b3d9-c96d0c01641a-crio-socket\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335226 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-run\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335245 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-system-cni-dir\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335252 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-etc-openvswitch\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335269 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-run-netns\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335276 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e87e5256-fef7-4160-b3d9-c96d0c01641a-crio-socket\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335290 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-var-lib-cni-bin\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335289 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-sysctl-conf\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335311 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-vlsf6\" (UID: \"4e036a5c-ee3f-4b8f-a173-b3b6c052bca7\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-vlsf6" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335327 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-var-lib-kubelet\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335325 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-run-netns\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335339 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-var-lib-cni-bin\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335349 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335370 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-var-lib-kubelet\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335325 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-system-cni-dir\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335376 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs\") pod \"network-metrics-daemon-xxcn8\" (UID: \"706127dc-f1c4-4724-aa56-ba5c5623bcf4\") " pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335394 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b8c5588a-b014-4899-bef7-bbb6b6bfebd4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vb2mz\" (UID: \"b8c5588a-b014-4899-bef7-bbb6b6bfebd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb2mz" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335419 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-run-netns\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335450 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-run-openvswitch\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335457 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-run-netns\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335474 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-systemd\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335499 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aa159b4a-95ad-4a99-ae91-995c34fc44c1-kubelet-config\") pod \"global-pull-secret-syncer-dh9b9\" (UID: \"aa159b4a-95ad-4a99-ae91-995c34fc44c1\") " pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335500 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-run-openvswitch\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335523 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-run-ovn-kubernetes\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335538 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-systemd\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335548 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-run-multus-certs\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335568 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aa159b4a-95ad-4a99-ae91-995c34fc44c1-kubelet-config\") pod \"global-pull-secret-syncer-dh9b9\" (UID: \"aa159b4a-95ad-4a99-ae91-995c34fc44c1\") " pod="kube-system/global-pull-secret-syncer-dh9b9" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335575 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/473ae29e-1292-4044-988e-293d9ae8cfe3-hosts-file\") pod \"node-resolver-4qdls\" (UID: \"473ae29e-1292-4044-988e-293d9ae8cfe3\") " pod="openshift-dns/node-resolver-4qdls" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335583 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-host-run-ovn-kubernetes\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335605 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-cnibin\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335616 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-run-multus-certs\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335629 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335634 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/473ae29e-1292-4044-988e-293d9ae8cfe3-hosts-file\") pod \"node-resolver-4qdls\" (UID: \"473ae29e-1292-4044-988e-293d9ae8cfe3\") " pod="openshift-dns/node-resolver-4qdls" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335656 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-sysctl-d\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335648 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-cnibin\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335681 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-multus-socket-dir-parent\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335698 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d31ffcc4-d558-4eec-94c0-3a6268fca6d3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qpq6z\" (UID: \"d31ffcc4-d558-4eec-94c0-3a6268fca6d3\") " pod="openshift-multus/multus-additional-cni-plugins-qpq6z" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335703 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-var-lib-kubelet\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335733 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-modprobe-d\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335750 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-host-var-lib-kubelet\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335766 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335794 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee3c09af-7a35-49ff-a0cb-4bafc08875b1-host\") pod \"node-ca-p4d9h\" (UID: \"ee3c09af-7a35-49ff-a0cb-4bafc08875b1\") " pod="openshift-image-registry/node-ca-p4d9h" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335798 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-sysctl-d\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335803 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-multus-socket-dir-parent\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335815 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d67d15cf-297b-4613-a63b-3c6dfa88bf8f-etc-modprobe-d\") pod \"tuned-sqzqg\" (UID: \"d67d15cf-297b-4613-a63b-3c6dfa88bf8f\") " pod="openshift-cluster-node-tuning-operator/tuned-sqzqg" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335849 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-log-socket\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:27.335870 5030 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 07:15:27.335851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335904 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e87e5256-fef7-4160-b3d9-c96d0c01641a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:27.339295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335923 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee3c09af-7a35-49ff-a0cb-4bafc08875b1-host\") pod \"node-ca-p4d9h\" (UID: \"ee3c09af-7a35-49ff-a0cb-4bafc08875b1\") " pod="openshift-image-registry/node-ca-p4d9h" Nov 04 07:15:27.339295 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:27.335951 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls podName:e87e5256-fef7-4160-b3d9-c96d0c01641a nodeName:}" failed. No retries permitted until 2026-11-04 07:15:27.835935031 +0000 UTC m=+1.818563220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nx4xj" (UID: "e87e5256-fef7-4160-b3d9-c96d0c01641a") : secret "insights-runtime-extractor-tls" not found Nov 04 07:15:27.339295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335981 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9084f3dd-8da4-431c-8040-1e268c3fa964-log-socket\") pod \"ovnkube-node-c4d9w\" (UID: \"9084f3dd-8da4-431c-8040-1e268c3fa964\") " pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:27.339295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.335986 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-hostroot\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.339295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.336161 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab2d1249-7775-4410-a8ef-8e03a4b362b9-hostroot\") pod \"multus-fschq\" (UID: \"ab2d1249-7775-4410-a8ef-8e03a4b362b9\") " pod="openshift-multus/multus-fschq" Nov 04 07:15:27.339295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.336466 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e87e5256-fef7-4160-b3d9-c96d0c01641a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:27.339295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.336863 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-tls\") pod \"image-registry-85f5799855-6xlbc\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:27.339295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.337504 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4e036a5c-ee3f-4b8f-a173-b3b6c052bca7-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-vlsf6\" (UID: \"4e036a5c-ee3f-4b8f-a173-b3b6c052bca7\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-vlsf6" Nov 04 07:15:27.339295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.337606 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/706127dc-f1c4-4724-aa56-ba5c5623bcf4-metrics-certs\") pod \"network-metrics-daemon-xxcn8\" (UID: \"706127dc-f1c4-4724-aa56-ba5c5623bcf4\") " pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:15:27.405379 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.405335 5030 scope.go:122] "RemoveContainer" containerID="c6ea87867881bbc8815dc1773196ebe237577567ccdee9931a6ddaa171204b45" Nov 04 07:15:27.405660 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.405641 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng" Nov 04 07:15:27.406581 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.406566 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" Nov 04 07:15:27.413459 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.413438 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-vlsf6" Nov 04 07:15:27.414749 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.414734 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:27.424202 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.424186 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:27.425349 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.425332 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xxcn8" Nov 04 07:15:27.524090 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.524064 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-hh854_5977e1b4-8c3a-42b7-8e3a-e152fd907bd4/migrator/0.log" Nov 04 07:15:27.709410 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.709386 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng"] Nov 04 07:15:27.712351 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:27.712326 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf12932cd_facc_4cf2_bd45_d359ae6d6012.slice/crio-86e388545c4e91fba756b3c4d55007ed6d65f1fdaa3dcf01e81a5a754ca36162 WatchSource:0}: Error finding container 86e388545c4e91fba756b3c4d55007ed6d65f1fdaa3dcf01e81a5a754ca36162: Status 404 returned error can't find the container with id 86e388545c4e91fba756b3c4d55007ed6d65f1fdaa3dcf01e81a5a754ca36162 Nov 04 07:15:27.714355 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.714337 5030 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 07:15:27.725237 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.725219 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-tlcjg_20da56ab-0718-406e-80c4-d8fb20ac7049/migrator/0.log" Nov 04 07:15:27.739858 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.739837 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:27.739997 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:27.739980 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle podName:c96c91ba-0da0-4c2c-a881-e3ffffe63714 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:28.739964541 +0000 UTC m=+2.722592715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle") pod "router-default-6d87c68c59-n7zhf" (UID: "c96c91ba-0da0-4c2c-a881-e3ffffe63714") : configmap references non-existent config key: service-ca.crt Nov 04 07:15:27.756149 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.756108 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8"] Nov 04 07:15:27.800456 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.800434 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xxcn8"] Nov 04 07:15:27.803686 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:27.803650 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod706127dc_f1c4_4724_aa56_ba5c5623bcf4.slice/crio-24f7fc440681ceff5308c2a824fe857f5f5df4a3f68d8cb1ca64c9ede908f7ee WatchSource:0}: Error finding container 24f7fc440681ceff5308c2a824fe857f5f5df4a3f68d8cb1ca64c9ede908f7ee: Status 404 returned error can't find the container with id 24f7fc440681ceff5308c2a824fe857f5f5df4a3f68d8cb1ca64c9ede908f7ee Nov 04 07:15:27.829306 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.829282 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67f4948c94-mmrkw"] Nov 04 07:15:27.832049 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:27.832021 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaff7a50_eb36_414b_a45e_5a0a56e3a8eb.slice/crio-2b0181a98796863a42699203cd2d9b36cf9ba870c605c702233bdf042da41c3a WatchSource:0}: Error finding container 2b0181a98796863a42699203cd2d9b36cf9ba870c605c702233bdf042da41c3a: Status 404 returned error can't find the container with id 2b0181a98796863a42699203cd2d9b36cf9ba870c605c702233bdf042da41c3a Nov 04 07:15:27.840704 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.840681 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:27.840778 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.840728 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8deda5b1-d839-4a8b-b902-8e341ffe5340-metrics-tls\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:27.840854 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:27.840836 5030 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 07:15:27.840915 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:27.840890 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls podName:e87e5256-fef7-4160-b3d9-c96d0c01641a nodeName:}" failed. No retries permitted until 2026-11-04 07:15:28.840873814 +0000 UTC m=+2.823501986 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nx4xj" (UID: "e87e5256-fef7-4160-b3d9-c96d0c01641a") : secret "insights-runtime-extractor-tls" not found Nov 04 07:15:27.843213 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.843198 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8deda5b1-d839-4a8b-b902-8e341ffe5340-metrics-tls\") pod \"dns-default-6x2rp\" (UID: \"8deda5b1-d839-4a8b-b902-8e341ffe5340\") " pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:27.846146 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.846104 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:27.855890 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.855870 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-vlsf6"] Nov 04 07:15:27.862284 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:27.862260 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e036a5c_ee3f_4b8f_a173_b3b6c052bca7.slice/crio-5669cd972b2d258620d891b70cd268609c3c7f4068832c362d438bede971e769 WatchSource:0}: Error finding container 5669cd972b2d258620d891b70cd268609c3c7f4068832c362d438bede971e769: Status 404 returned error can't find the container with id 5669cd972b2d258620d891b70cd268609c3c7f4068832c362d438bede971e769 Nov 04 07:15:27.889760 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.889686 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85f5799855-6xlbc"] Nov 04 07:15:27.892655 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:27.892631 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb5b977d_e13b_4499_8f7d_57b96f1b62bb.slice/crio-a95570c014cc92e7386eb5202888346a1568eec29bc360b5020f407f36759684 WatchSource:0}: Error finding container a95570c014cc92e7386eb5202888346a1568eec29bc360b5020f407f36759684: Status 404 returned error can't find the container with id a95570c014cc92e7386eb5202888346a1568eec29bc360b5020f407f36759684 Nov 04 07:15:27.924404 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:27.924380 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp_9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb/kube-storage-version-migrator-operator/0.log" Nov 04 07:15:28.027077 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:28.027027 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:28.207159 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:28.207053 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xxcn8" event={"ID":"706127dc-f1c4-4724-aa56-ba5c5623bcf4","Type":"ContainerStarted","Data":"24f7fc440681ceff5308c2a824fe857f5f5df4a3f68d8cb1ca64c9ede908f7ee"} Nov 04 07:15:28.208633 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:28.208589 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng" event={"ID":"f12932cd-facc-4cf2-bd45-d359ae6d6012","Type":"ContainerStarted","Data":"86e388545c4e91fba756b3c4d55007ed6d65f1fdaa3dcf01e81a5a754ca36162"} Nov 04 07:15:28.210968 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:28.210621 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" event={"ID":"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb","Type":"ContainerStarted","Data":"cddc52f4b34a602bb12d1be490b82ec568c838e8665c5246f4aea9b7a31ee884"} Nov 04 07:15:28.210968 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:28.210668 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" event={"ID":"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb","Type":"ContainerStarted","Data":"2b0181a98796863a42699203cd2d9b36cf9ba870c605c702233bdf042da41c3a"} Nov 04 07:15:28.213125 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:28.213099 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" event={"ID":"3ea0ef4d-2fdb-4090-965f-3db3237a4c69","Type":"ContainerStarted","Data":"61087a50dcfb1b0e47898ef3e01f2e695069c40fe5a5b9a4dd97ae6db1785c3f"} Nov 04 07:15:28.215836 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:28.214895 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85f5799855-6xlbc" event={"ID":"fb5b977d-e13b-4499-8f7d-57b96f1b62bb","Type":"ContainerStarted","Data":"42978db2a2d91c61fd7872b322fcc7840d1763aebcdb8ad54d626ab4eb67a238"} Nov 04 07:15:28.215836 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:28.214942 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85f5799855-6xlbc" event={"ID":"fb5b977d-e13b-4499-8f7d-57b96f1b62bb","Type":"ContainerStarted","Data":"a95570c014cc92e7386eb5202888346a1568eec29bc360b5020f407f36759684"} Nov 04 07:15:28.217301 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:28.217282 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-9k9rx_ecfd331a-08c4-43ac-a58c-9f43935d06ed/console-operator/2.log" Nov 04 07:15:28.217799 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:28.217779 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-9k9rx_ecfd331a-08c4-43ac-a58c-9f43935d06ed/console-operator/1.log" Nov 04 07:15:28.217863 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:28.217819 5030 generic.go:356] "Generic (PLEG): container finished" podID="ecfd331a-08c4-43ac-a58c-9f43935d06ed" containerID="224bc6a14d51d3e175f33ec6234f180c76f97288abf26a24bc6ac84daa3cdc4f" exitCode=255 Nov 04 07:15:28.217918 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:28.217900 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" event={"ID":"ecfd331a-08c4-43ac-a58c-9f43935d06ed","Type":"ContainerDied","Data":"224bc6a14d51d3e175f33ec6234f180c76f97288abf26a24bc6ac84daa3cdc4f"} Nov 04 07:15:28.217978 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:28.217952 5030 scope.go:122] "RemoveContainer" containerID="c6ea87867881bbc8815dc1773196ebe237577567ccdee9931a6ddaa171204b45" Nov 04 07:15:28.218115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:28.218097 5030 scope.go:122] "RemoveContainer" containerID="224bc6a14d51d3e175f33ec6234f180c76f97288abf26a24bc6ac84daa3cdc4f" Nov 04 07:15:28.218408 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:28.218384 5030 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-9k9rx_openshift-console-operator(ecfd331a-08c4-43ac-a58c-9f43935d06ed)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" podUID="ecfd331a-08c4-43ac-a58c-9f43935d06ed" Nov 04 07:15:28.220102 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:28.220084 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-vlsf6" event={"ID":"4e036a5c-ee3f-4b8f-a173-b3b6c052bca7","Type":"ContainerStarted","Data":"5669cd972b2d258620d891b70cd268609c3c7f4068832c362d438bede971e769"} Nov 04 07:15:28.308123 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:28.308093 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6x2rp"] Nov 04 07:15:28.749231 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:28.749193 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:28.749517 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:28.749422 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle podName:c96c91ba-0da0-4c2c-a881-e3ffffe63714 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:30.749405204 +0000 UTC m=+4.732033379 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle") pod "router-default-6d87c68c59-n7zhf" (UID: "c96c91ba-0da0-4c2c-a881-e3ffffe63714") : configmap references non-existent config key: service-ca.crt Nov 04 07:15:28.850967 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:28.850368 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:28.850967 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:28.850531 5030 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 07:15:28.850967 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:28.850594 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls podName:e87e5256-fef7-4160-b3d9-c96d0c01641a nodeName:}" failed. No retries permitted until 2026-11-04 07:15:30.850577003 +0000 UTC m=+4.833205190 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nx4xj" (UID: "e87e5256-fef7-4160-b3d9-c96d0c01641a") : secret "insights-runtime-extractor-tls" not found Nov 04 07:15:29.234367 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:29.234336 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-9k9rx_ecfd331a-08c4-43ac-a58c-9f43935d06ed/console-operator/2.log" Nov 04 07:15:29.234813 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:29.234758 5030 scope.go:122] "RemoveContainer" containerID="224bc6a14d51d3e175f33ec6234f180c76f97288abf26a24bc6ac84daa3cdc4f" Nov 04 07:15:29.234969 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:29.234944 5030 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-9k9rx_openshift-console-operator(ecfd331a-08c4-43ac-a58c-9f43935d06ed)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" podUID="ecfd331a-08c4-43ac-a58c-9f43935d06ed" Nov 04 07:15:29.243178 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:29.243082 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6x2rp" event={"ID":"8deda5b1-d839-4a8b-b902-8e341ffe5340","Type":"ContainerStarted","Data":"ac86d1c7709ffa98550dd0db2d6dfa329bf57191418eca2a26f14fde86e00757"} Nov 04 07:15:29.246450 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:29.245678 5030 generic.go:356] "Generic (PLEG): container finished" podID="9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb" containerID="8446faffe2312fd51f23a50b7feeffbd7b27e8e6ddf57096cb6b148b028e0096" exitCode=0 Nov 04 07:15:29.246450 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:29.245781 5030 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 07:15:29.246450 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:29.246283 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp" event={"ID":"9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb","Type":"ContainerDied","Data":"8446faffe2312fd51f23a50b7feeffbd7b27e8e6ddf57096cb6b148b028e0096"} Nov 04 07:15:29.247449 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:29.246871 5030 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 07:15:29.247449 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:29.246941 5030 scope.go:122] "RemoveContainer" containerID="8446faffe2312fd51f23a50b7feeffbd7b27e8e6ddf57096cb6b148b028e0096" Nov 04 07:15:29.387276 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:29.385816 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:29.431224 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:29.429697 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:29.776989 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:29.776964 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:30.260558 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:30.259902 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-ldnjp" event={"ID":"9a7c1c3f-c12e-4bcc-966d-79f5f08a97bb","Type":"ContainerStarted","Data":"c4071929dcb05a0f56ae51e93ccada853af19da9a6fca7ead3a94aa57b717f04"} Nov 04 07:15:30.263074 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:30.263044 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xxcn8" event={"ID":"706127dc-f1c4-4724-aa56-ba5c5623bcf4","Type":"ContainerStarted","Data":"02791c0156371d144e51bfee9e8b957e6fe0988b58b8aecf8c77ac93c0c40020"} Nov 04 07:15:30.263229 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:30.263101 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xxcn8" event={"ID":"706127dc-f1c4-4724-aa56-ba5c5623bcf4","Type":"ContainerStarted","Data":"4b52fe7fb15f72c6d866448d5a9f07846fe86fbf941bb859063da59440871136"} Nov 04 07:15:30.266024 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:30.266001 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-vlsf6" event={"ID":"4e036a5c-ee3f-4b8f-a173-b3b6c052bca7","Type":"ContainerStarted","Data":"2f413f40dbf5cd527b8cc60972db8a2578a329d2285f81910366150b4c8e21e1"} Nov 04 07:15:30.266199 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:30.266180 5030 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 07:15:30.770712 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:30.770675 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:30.770864 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:30.770847 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle podName:c96c91ba-0da0-4c2c-a881-e3ffffe63714 nodeName:}" failed. No retries permitted until 2026-11-04 07:15:34.770829235 +0000 UTC m=+8.753457434 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle") pod "router-default-6d87c68c59-n7zhf" (UID: "c96c91ba-0da0-4c2c-a881-e3ffffe63714") : configmap references non-existent config key: service-ca.crt Nov 04 07:15:30.871108 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:30.871078 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:30.871238 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:30.871210 5030 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 07:15:30.871277 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:30.871264 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls podName:e87e5256-fef7-4160-b3d9-c96d0c01641a nodeName:}" failed. No retries permitted until 2026-11-04 07:15:34.871250809 +0000 UTC m=+8.853878979 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nx4xj" (UID: "e87e5256-fef7-4160-b3d9-c96d0c01641a") : secret "insights-runtime-extractor-tls" not found Nov 04 07:15:31.270915 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:31.270874 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-hb4ng" event={"ID":"f12932cd-facc-4cf2-bd45-d359ae6d6012","Type":"ContainerStarted","Data":"a1544965fc600fd0110fb342f60fe2ecc63c135eac605c4112832d792f7c93c9"} Nov 04 07:15:31.272962 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:31.272927 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" event={"ID":"3ea0ef4d-2fdb-4090-965f-3db3237a4c69","Type":"ContainerStarted","Data":"3442a984c5df4a8a9d6054037735206c3583f8f4b24f4b49250d7460ce9cde10"} Nov 04 07:15:31.273104 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:31.272990 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jrqx8" event={"ID":"3ea0ef4d-2fdb-4090-965f-3db3237a4c69","Type":"ContainerStarted","Data":"20b7609450b525403d5db183cc16c3db739b5d7450a15527d5d1684ade228e71"} Nov 04 07:15:31.274977 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:31.274937 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6x2rp" event={"ID":"8deda5b1-d839-4a8b-b902-8e341ffe5340","Type":"ContainerStarted","Data":"4d86d0af3d3b87ae5746d7629fb60052965af05facdb1209c2e802f7a220db65"} Nov 04 07:15:31.275110 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:31.274985 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6x2rp" event={"ID":"8deda5b1-d839-4a8b-b902-8e341ffe5340","Type":"ContainerStarted","Data":"f4b51d6fa546e36a50428933c5dfa2ca11dbed23711d54aeef559bdea4d435b6"} Nov 04 07:15:31.472250 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:31.472224 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:31.770146 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:31.770112 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:15:32.278878 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:32.278839 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:34.795732 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:34.795687 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:34.796396 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:34.796367 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c96c91ba-0da0-4c2c-a881-e3ffffe63714-service-ca-bundle\") pod \"router-default-6d87c68c59-n7zhf\" (UID: \"c96c91ba-0da0-4c2c-a881-e3ffffe63714\") " pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:34.897032 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:34.896997 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:34.899391 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:34.899368 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e87e5256-fef7-4160-b3d9-c96d0c01641a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nx4xj\" (UID: \"e87e5256-fef7-4160-b3d9-c96d0c01641a\") " pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:34.909316 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:34.909292 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:34.933212 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:34.933185 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nx4xj" Nov 04 07:15:35.191562 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:35.191537 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d87c68c59-n7zhf"] Nov 04 07:15:35.193948 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:35.193921 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc96c91ba_0da0_4c2c_a881_e3ffffe63714.slice/crio-6c3cfab6002ece59b212bc987de2a353ee38db44405ea8ec4c39df057e300420 WatchSource:0}: Error finding container 6c3cfab6002ece59b212bc987de2a353ee38db44405ea8ec4c39df057e300420: Status 404 returned error can't find the container with id 6c3cfab6002ece59b212bc987de2a353ee38db44405ea8ec4c39df057e300420 Nov 04 07:15:35.218944 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:35.218920 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nx4xj"] Nov 04 07:15:35.226093 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:35.226066 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode87e5256_fef7_4160_b3d9_c96d0c01641a.slice/crio-b8ddf09febe4f836e6af9d45eac045fa66cc0fd73a6361f33c940e4a241a5bdb WatchSource:0}: Error finding container b8ddf09febe4f836e6af9d45eac045fa66cc0fd73a6361f33c940e4a241a5bdb: Status 404 returned error can't find the container with id b8ddf09febe4f836e6af9d45eac045fa66cc0fd73a6361f33c940e4a241a5bdb Nov 04 07:15:35.298284 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:35.298250 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d87c68c59-n7zhf" event={"ID":"c96c91ba-0da0-4c2c-a881-e3ffffe63714","Type":"ContainerStarted","Data":"6475484cb94aa6d14695a1e126bdd0cca275cd6db0b49e9ef8d589b484b7d458"} Nov 04 07:15:35.298427 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:35.298300 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d87c68c59-n7zhf" event={"ID":"c96c91ba-0da0-4c2c-a881-e3ffffe63714","Type":"ContainerStarted","Data":"6c3cfab6002ece59b212bc987de2a353ee38db44405ea8ec4c39df057e300420"} Nov 04 07:15:35.302042 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:35.302017 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nx4xj" event={"ID":"e87e5256-fef7-4160-b3d9-c96d0c01641a","Type":"ContainerStarted","Data":"67453717e92de205e877c2a7605e247d623c08015974902a3f19b04af6d0b91d"} Nov 04 07:15:35.302190 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:35.302068 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nx4xj" event={"ID":"e87e5256-fef7-4160-b3d9-c96d0c01641a","Type":"ContainerStarted","Data":"b8ddf09febe4f836e6af9d45eac045fa66cc0fd73a6361f33c940e4a241a5bdb"} Nov 04 07:15:35.644571 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:35.644493 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:35.909487 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:35.909464 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:35.911944 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:35.911925 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:36.307198 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:36.307170 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nx4xj" event={"ID":"e87e5256-fef7-4160-b3d9-c96d0c01641a","Type":"ContainerStarted","Data":"9af55be2e2de6bef33a408583cbc8ac12d2724442cd9a77520ca338cf0dec964"} Nov 04 07:15:36.308660 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:36.308641 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6d87c68c59-n7zhf" Nov 04 07:15:36.519104 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:36.519077 5030 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:36.519395 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:36.519382 5030 scope.go:122] "RemoveContainer" containerID="224bc6a14d51d3e175f33ec6234f180c76f97288abf26a24bc6ac84daa3cdc4f" Nov 04 07:15:36.519543 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:36.519527 5030 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-9k9rx_openshift-console-operator(ecfd331a-08c4-43ac-a58c-9f43935d06ed)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" podUID="ecfd331a-08c4-43ac-a58c-9f43935d06ed" Nov 04 07:15:37.846339 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:37.846275 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:37.846656 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:37.846637 5030 scope.go:122] "RemoveContainer" containerID="224bc6a14d51d3e175f33ec6234f180c76f97288abf26a24bc6ac84daa3cdc4f" Nov 04 07:15:38.324953 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:38.324916 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nx4xj" event={"ID":"e87e5256-fef7-4160-b3d9-c96d0c01641a","Type":"ContainerStarted","Data":"7e497d52e621ec97b94d2dde6f0372b088b8e6bdc68a0911d0a3ef6435205a32"} Nov 04 07:15:38.327766 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:38.327733 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-9k9rx_ecfd331a-08c4-43ac-a58c-9f43935d06ed/console-operator/2.log" Nov 04 07:15:38.327939 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:38.327871 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" event={"ID":"ecfd331a-08c4-43ac-a58c-9f43935d06ed","Type":"ContainerStarted","Data":"55835a0476eb14f4f6b67224bd50ae47529a2b5385f9555a83bff5f92c08f7ab"} Nov 04 07:15:38.328284 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:38.328260 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:38.337745 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:38.337719 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-9k9rx" Nov 04 07:15:40.262226 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:40.262187 5030 patch_prober.go:29] interesting pod/image-registry-67f4948c94-mmrkw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Nov 04 07:15:40.262625 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:40.262247 5030 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" podUID="aaff7a50-eb36-414b-a45e-5a0a56e3a8eb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 07:15:41.694123 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:41.694091 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d9d49" Nov 04 07:15:42.288170 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:42.288106 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6x2rp" Nov 04 07:15:43.683248 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.683209 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67f4948c94-mmrkw"] Nov 04 07:15:43.684245 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.684218 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-dt85l"] Nov 04 07:15:43.689102 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.688997 5030 patch_prober.go:29] interesting pod/image-registry-67f4948c94-mmrkw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Nov 04 07:15:43.689102 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.689055 5030 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" podUID="aaff7a50-eb36-414b-a45e-5a0a56e3a8eb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 07:15:43.689258 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.689127 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-zgqlr"] Nov 04 07:15:43.689450 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.689428 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-dt85l" Nov 04 07:15:43.692639 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.692619 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-zgqlr" Nov 04 07:15:43.699160 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.699121 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-nzvfh\"" Nov 04 07:15:43.701324 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.701303 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Nov 04 07:15:43.701818 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.701778 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Nov 04 07:15:43.702076 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.702048 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Nov 04 07:15:43.704993 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.702948 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-dt85l"] Nov 04 07:15:43.707894 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.707870 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-gtfdp\"" Nov 04 07:15:43.708896 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.708875 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-zgqlr"] Nov 04 07:15:43.766624 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.766593 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbshf\" (UniqueName: \"kubernetes.io/projected/b214cd37-e13b-4d6e-8550-7b43b7abe4c5-kube-api-access-lbshf\") pod \"downloads-6dd789c8b7-zgqlr\" (UID: \"b214cd37-e13b-4d6e-8550-7b43b7abe4c5\") " pod="openshift-console/downloads-6dd789c8b7-zgqlr" Nov 04 07:15:43.766769 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.766669 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b214cd37-e13b-4d6e-8550-7b43b7abe4c5-tmp\") pod \"downloads-6dd789c8b7-zgqlr\" (UID: \"b214cd37-e13b-4d6e-8550-7b43b7abe4c5\") " pod="openshift-console/downloads-6dd789c8b7-zgqlr" Nov 04 07:15:43.766769 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.766744 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5c2bf7dd-35c2-400f-8d4f-96915d5c7ef6-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-dt85l\" (UID: \"5c2bf7dd-35c2-400f-8d4f-96915d5c7ef6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-dt85l" Nov 04 07:15:43.786707 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.786677 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-bdf74958f-jbtcn"] Nov 04 07:15:43.789820 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.789801 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:43.844746 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.844725 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bdf74958f-jbtcn"] Nov 04 07:15:43.868082 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.868055 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d9b2c9c-957c-4f86-902c-aad734e66096-registry-tls\") pod \"image-registry-bdf74958f-jbtcn\" (UID: \"4d9b2c9c-957c-4f86-902c-aad734e66096\") " pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:43.868180 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.868089 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d9b2c9c-957c-4f86-902c-aad734e66096-ca-trust-extracted\") pod \"image-registry-bdf74958f-jbtcn\" (UID: \"4d9b2c9c-957c-4f86-902c-aad734e66096\") " pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:43.868180 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.868112 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b214cd37-e13b-4d6e-8550-7b43b7abe4c5-tmp\") pod \"downloads-6dd789c8b7-zgqlr\" (UID: \"b214cd37-e13b-4d6e-8550-7b43b7abe4c5\") " pod="openshift-console/downloads-6dd789c8b7-zgqlr" Nov 04 07:15:43.868254 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.868191 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5c2bf7dd-35c2-400f-8d4f-96915d5c7ef6-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-dt85l\" (UID: \"5c2bf7dd-35c2-400f-8d4f-96915d5c7ef6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-dt85l" Nov 04 07:15:43.868295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.868281 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d9b2c9c-957c-4f86-902c-aad734e66096-image-registry-private-configuration\") pod \"image-registry-bdf74958f-jbtcn\" (UID: \"4d9b2c9c-957c-4f86-902c-aad734e66096\") " pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:43.868337 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.868313 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbshf\" (UniqueName: \"kubernetes.io/projected/b214cd37-e13b-4d6e-8550-7b43b7abe4c5-kube-api-access-lbshf\") pod \"downloads-6dd789c8b7-zgqlr\" (UID: \"b214cd37-e13b-4d6e-8550-7b43b7abe4c5\") " pod="openshift-console/downloads-6dd789c8b7-zgqlr" Nov 04 07:15:43.868369 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.868336 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d9b2c9c-957c-4f86-902c-aad734e66096-registry-certificates\") pod \"image-registry-bdf74958f-jbtcn\" (UID: \"4d9b2c9c-957c-4f86-902c-aad734e66096\") " pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:43.868369 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.868353 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d9b2c9c-957c-4f86-902c-aad734e66096-installation-pull-secrets\") pod \"image-registry-bdf74958f-jbtcn\" (UID: \"4d9b2c9c-957c-4f86-902c-aad734e66096\") " pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:43.868498 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.868483 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d9b2c9c-957c-4f86-902c-aad734e66096-bound-sa-token\") pod \"image-registry-bdf74958f-jbtcn\" (UID: \"4d9b2c9c-957c-4f86-902c-aad734e66096\") " pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:43.868529 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.868510 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d9b2c9c-957c-4f86-902c-aad734e66096-trusted-ca\") pod \"image-registry-bdf74958f-jbtcn\" (UID: \"4d9b2c9c-957c-4f86-902c-aad734e66096\") " pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:43.868529 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.868515 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b214cd37-e13b-4d6e-8550-7b43b7abe4c5-tmp\") pod \"downloads-6dd789c8b7-zgqlr\" (UID: \"b214cd37-e13b-4d6e-8550-7b43b7abe4c5\") " pod="openshift-console/downloads-6dd789c8b7-zgqlr" Nov 04 07:15:43.868660 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.868567 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44vx2\" (UniqueName: \"kubernetes.io/projected/4d9b2c9c-957c-4f86-902c-aad734e66096-kube-api-access-44vx2\") pod \"image-registry-bdf74958f-jbtcn\" (UID: \"4d9b2c9c-957c-4f86-902c-aad734e66096\") " pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:43.870585 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.870564 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5c2bf7dd-35c2-400f-8d4f-96915d5c7ef6-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-dt85l\" (UID: \"5c2bf7dd-35c2-400f-8d4f-96915d5c7ef6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-dt85l" Nov 04 07:15:43.900821 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.900798 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbshf\" (UniqueName: \"kubernetes.io/projected/b214cd37-e13b-4d6e-8550-7b43b7abe4c5-kube-api-access-lbshf\") pod \"downloads-6dd789c8b7-zgqlr\" (UID: \"b214cd37-e13b-4d6e-8550-7b43b7abe4c5\") " pod="openshift-console/downloads-6dd789c8b7-zgqlr" Nov 04 07:15:43.969287 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.969232 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d9b2c9c-957c-4f86-902c-aad734e66096-registry-certificates\") pod \"image-registry-bdf74958f-jbtcn\" (UID: \"4d9b2c9c-957c-4f86-902c-aad734e66096\") " pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:43.969287 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.969263 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d9b2c9c-957c-4f86-902c-aad734e66096-installation-pull-secrets\") pod \"image-registry-bdf74958f-jbtcn\" (UID: \"4d9b2c9c-957c-4f86-902c-aad734e66096\") " pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:43.969287 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.969280 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d9b2c9c-957c-4f86-902c-aad734e66096-bound-sa-token\") pod \"image-registry-bdf74958f-jbtcn\" (UID: \"4d9b2c9c-957c-4f86-902c-aad734e66096\") " pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:43.969507 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.969298 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d9b2c9c-957c-4f86-902c-aad734e66096-trusted-ca\") pod \"image-registry-bdf74958f-jbtcn\" (UID: \"4d9b2c9c-957c-4f86-902c-aad734e66096\") " pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:43.969507 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.969434 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44vx2\" (UniqueName: \"kubernetes.io/projected/4d9b2c9c-957c-4f86-902c-aad734e66096-kube-api-access-44vx2\") pod \"image-registry-bdf74958f-jbtcn\" (UID: \"4d9b2c9c-957c-4f86-902c-aad734e66096\") " pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:43.969507 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.969481 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d9b2c9c-957c-4f86-902c-aad734e66096-registry-tls\") pod \"image-registry-bdf74958f-jbtcn\" (UID: \"4d9b2c9c-957c-4f86-902c-aad734e66096\") " pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:43.969662 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.969536 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d9b2c9c-957c-4f86-902c-aad734e66096-ca-trust-extracted\") pod \"image-registry-bdf74958f-jbtcn\" (UID: \"4d9b2c9c-957c-4f86-902c-aad734e66096\") " pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:43.969662 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.969596 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d9b2c9c-957c-4f86-902c-aad734e66096-image-registry-private-configuration\") pod \"image-registry-bdf74958f-jbtcn\" (UID: \"4d9b2c9c-957c-4f86-902c-aad734e66096\") " pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:43.970011 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.969975 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d9b2c9c-957c-4f86-902c-aad734e66096-ca-trust-extracted\") pod \"image-registry-bdf74958f-jbtcn\" (UID: \"4d9b2c9c-957c-4f86-902c-aad734e66096\") " pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:43.970122 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.970053 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d9b2c9c-957c-4f86-902c-aad734e66096-registry-certificates\") pod \"image-registry-bdf74958f-jbtcn\" (UID: \"4d9b2c9c-957c-4f86-902c-aad734e66096\") " pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:43.970367 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.970348 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d9b2c9c-957c-4f86-902c-aad734e66096-trusted-ca\") pod \"image-registry-bdf74958f-jbtcn\" (UID: \"4d9b2c9c-957c-4f86-902c-aad734e66096\") " pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:43.971719 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.971701 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d9b2c9c-957c-4f86-902c-aad734e66096-registry-tls\") pod \"image-registry-bdf74958f-jbtcn\" (UID: \"4d9b2c9c-957c-4f86-902c-aad734e66096\") " pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:43.971996 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.971978 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d9b2c9c-957c-4f86-902c-aad734e66096-installation-pull-secrets\") pod \"image-registry-bdf74958f-jbtcn\" (UID: \"4d9b2c9c-957c-4f86-902c-aad734e66096\") " pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:43.972064 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.972042 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d9b2c9c-957c-4f86-902c-aad734e66096-image-registry-private-configuration\") pod \"image-registry-bdf74958f-jbtcn\" (UID: \"4d9b2c9c-957c-4f86-902c-aad734e66096\") " pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:43.984993 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.984966 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44vx2\" (UniqueName: \"kubernetes.io/projected/4d9b2c9c-957c-4f86-902c-aad734e66096-kube-api-access-44vx2\") pod \"image-registry-bdf74958f-jbtcn\" (UID: \"4d9b2c9c-957c-4f86-902c-aad734e66096\") " pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:43.987459 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:43.987438 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d9b2c9c-957c-4f86-902c-aad734e66096-bound-sa-token\") pod \"image-registry-bdf74958f-jbtcn\" (UID: \"4d9b2c9c-957c-4f86-902c-aad734e66096\") " pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:44.008846 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:44.008824 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-dt85l" Nov 04 07:15:44.016864 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:44.016840 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-zgqlr" Nov 04 07:15:44.101290 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:44.101266 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:44.285295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:44.285110 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-dt85l"] Nov 04 07:15:44.287893 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:44.287867 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c2bf7dd_35c2_400f_8d4f_96915d5c7ef6.slice/crio-518938001b1c2f0273e0510e6b138d7f4b466996a2d1c6ba7d570a243c14b7a3 WatchSource:0}: Error finding container 518938001b1c2f0273e0510e6b138d7f4b466996a2d1c6ba7d570a243c14b7a3: Status 404 returned error can't find the container with id 518938001b1c2f0273e0510e6b138d7f4b466996a2d1c6ba7d570a243c14b7a3 Nov 04 07:15:44.307691 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:44.307665 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-zgqlr"] Nov 04 07:15:44.309913 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:44.309888 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb214cd37_e13b_4d6e_8550_7b43b7abe4c5.slice/crio-8cfa3bd27601e82eafb93aa60f28a4686c3268e13fd5ac864da781e1dd951337 WatchSource:0}: Error finding container 8cfa3bd27601e82eafb93aa60f28a4686c3268e13fd5ac864da781e1dd951337: Status 404 returned error can't find the container with id 8cfa3bd27601e82eafb93aa60f28a4686c3268e13fd5ac864da781e1dd951337 Nov 04 07:15:44.352641 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:44.352612 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-dt85l" event={"ID":"5c2bf7dd-35c2-400f-8d4f-96915d5c7ef6","Type":"ContainerStarted","Data":"518938001b1c2f0273e0510e6b138d7f4b466996a2d1c6ba7d570a243c14b7a3"} Nov 04 07:15:44.353796 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:44.353770 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-zgqlr" event={"ID":"b214cd37-e13b-4d6e-8550-7b43b7abe4c5","Type":"ContainerStarted","Data":"8cfa3bd27601e82eafb93aa60f28a4686c3268e13fd5ac864da781e1dd951337"} Nov 04 07:15:44.379004 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:44.378982 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bdf74958f-jbtcn"] Nov 04 07:15:44.381517 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:44.381496 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d9b2c9c_957c_4f86_902c_aad734e66096.slice/crio-a8b3d170234378355a0e859a78b377f64237eb3522bfd7e62aae8ac16c9e1165 WatchSource:0}: Error finding container a8b3d170234378355a0e859a78b377f64237eb3522bfd7e62aae8ac16c9e1165: Status 404 returned error can't find the container with id a8b3d170234378355a0e859a78b377f64237eb3522bfd7e62aae8ac16c9e1165 Nov 04 07:15:45.360756 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:45.360720 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" event={"ID":"4d9b2c9c-957c-4f86-902c-aad734e66096","Type":"ContainerStarted","Data":"d0bbd1ea073802f4bc22078fc4d0928ccc19d7362d2d1f4667e49383d737c227"} Nov 04 07:15:45.361185 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:45.360772 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" event={"ID":"4d9b2c9c-957c-4f86-902c-aad734e66096","Type":"ContainerStarted","Data":"a8b3d170234378355a0e859a78b377f64237eb3522bfd7e62aae8ac16c9e1165"} Nov 04 07:15:45.361185 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:45.360865 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:15:45.389440 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:45.389385 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" podStartSLOduration=2.389371643 podStartE2EDuration="2.389371643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:15:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:15:45.387444466 +0000 UTC m=+19.370072658" watchObservedRunningTime="2026-11-04 07:15:45.389371643 +0000 UTC m=+19.371999876" Nov 04 07:15:45.669873 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:45.669836 5030 patch_prober.go:29] interesting pod/image-registry-85f5799855-6xlbc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Nov 04 07:15:45.670030 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:45.669892 5030 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-85f5799855-6xlbc" podUID="fb5b977d-e13b-4499-8f7d-57b96f1b62bb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 07:15:46.366491 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:46.366452 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-dt85l" event={"ID":"5c2bf7dd-35c2-400f-8d4f-96915d5c7ef6","Type":"ContainerStarted","Data":"b4a1a5a63a1510f6a988bae832519e9b63e12ecd0b60a04a5530cdd6da755837"} Nov 04 07:15:46.367025 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:46.367003 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-dt85l" Nov 04 07:15:46.372147 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:46.372115 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-dt85l" Nov 04 07:15:46.386057 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:46.386004 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-dt85l" podStartSLOduration=2.242558754 podStartE2EDuration="3.385959747s" totalImagesPullingTime="1.143400993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:15:46.385055547 +0000 UTC m=+20.367683741" watchObservedRunningTime="2026-11-04 07:15:46.385959747 +0000 UTC m=+20.368587942" Nov 04 07:15:50.271514 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:50.271482 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:15:51.575842 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.575812 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xnt59"] Nov 04 07:15:51.609837 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.609806 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.666915 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.666884 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Nov 04 07:15:51.667042 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.667022 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Nov 04 07:15:51.667376 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.667361 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Nov 04 07:15:51.667524 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.667510 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Nov 04 07:15:51.667687 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.667671 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l2xtx\"" Nov 04 07:15:51.737245 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.737212 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/83169317-50c1-49f2-b371-b9773e8c3b77-node-exporter-textfile\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.737356 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.737259 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/83169317-50c1-49f2-b371-b9773e8c3b77-node-exporter-wtmp\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.737411 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.737358 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83169317-50c1-49f2-b371-b9773e8c3b77-node-exporter-tls\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.737411 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.737394 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83169317-50c1-49f2-b371-b9773e8c3b77-metrics-client-ca\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.737491 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.737418 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fmn5\" (UniqueName: \"kubernetes.io/projected/83169317-50c1-49f2-b371-b9773e8c3b77-kube-api-access-8fmn5\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.737491 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.737480 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/83169317-50c1-49f2-b371-b9773e8c3b77-node-exporter-accelerators-collector-config\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.737569 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.737505 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/83169317-50c1-49f2-b371-b9773e8c3b77-root\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.737569 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.737530 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83169317-50c1-49f2-b371-b9773e8c3b77-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.737569 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.737548 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83169317-50c1-49f2-b371-b9773e8c3b77-sys\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.838278 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.838212 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83169317-50c1-49f2-b371-b9773e8c3b77-sys\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.838410 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.838300 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/83169317-50c1-49f2-b371-b9773e8c3b77-node-exporter-textfile\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.838410 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.838328 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83169317-50c1-49f2-b371-b9773e8c3b77-sys\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.838410 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.838332 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/83169317-50c1-49f2-b371-b9773e8c3b77-node-exporter-wtmp\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.838578 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.838423 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83169317-50c1-49f2-b371-b9773e8c3b77-node-exporter-tls\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.838578 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.838451 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/83169317-50c1-49f2-b371-b9773e8c3b77-node-exporter-wtmp\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.838578 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.838456 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83169317-50c1-49f2-b371-b9773e8c3b77-metrics-client-ca\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.838578 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.838493 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fmn5\" (UniqueName: \"kubernetes.io/projected/83169317-50c1-49f2-b371-b9773e8c3b77-kube-api-access-8fmn5\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.838578 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.838533 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/83169317-50c1-49f2-b371-b9773e8c3b77-node-exporter-accelerators-collector-config\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.838578 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.838563 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/83169317-50c1-49f2-b371-b9773e8c3b77-root\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.838865 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.838596 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83169317-50c1-49f2-b371-b9773e8c3b77-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.838865 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.838661 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/83169317-50c1-49f2-b371-b9773e8c3b77-node-exporter-textfile\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.838865 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.838815 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/83169317-50c1-49f2-b371-b9773e8c3b77-root\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.839084 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.839063 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83169317-50c1-49f2-b371-b9773e8c3b77-metrics-client-ca\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.839214 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.839194 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/83169317-50c1-49f2-b371-b9773e8c3b77-node-exporter-accelerators-collector-config\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.841072 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.841000 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83169317-50c1-49f2-b371-b9773e8c3b77-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.842437 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.842423 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83169317-50c1-49f2-b371-b9773e8c3b77-node-exporter-tls\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.852777 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.852750 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fmn5\" (UniqueName: \"kubernetes.io/projected/83169317-50c1-49f2-b371-b9773e8c3b77-kube-api-access-8fmn5\") pod \"node-exporter-xnt59\" (UID: \"83169317-50c1-49f2-b371-b9773e8c3b77\") " pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:51.984262 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:51.984232 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xnt59" Nov 04 07:15:52.017951 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:15:52.017920 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83169317_50c1_49f2_b371_b9773e8c3b77.slice/crio-4509152e3fab1da1887676050b1ac94d6583df61dbf40d903130f4c40570ed83 WatchSource:0}: Error finding container 4509152e3fab1da1887676050b1ac94d6583df61dbf40d903130f4c40570ed83: Status 404 returned error can't find the container with id 4509152e3fab1da1887676050b1ac94d6583df61dbf40d903130f4c40570ed83 Nov 04 07:15:52.147670 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:15:52.147590 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:15:52.397402 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:52.397362 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xnt59" event={"ID":"83169317-50c1-49f2-b371-b9773e8c3b77","Type":"ContainerStarted","Data":"4509152e3fab1da1887676050b1ac94d6583df61dbf40d903130f4c40570ed83"} Nov 04 07:15:52.847710 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:52.847041 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c4d9w" Nov 04 07:15:53.689626 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:53.689601 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:15:54.408302 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:54.408265 5030 generic.go:356] "Generic (PLEG): container finished" podID="83169317-50c1-49f2-b371-b9773e8c3b77" containerID="5a417ee56e42cf6afba5d19cc42df6c663d2cbc6d286735f9461bb3855748dfc" exitCode=0 Nov 04 07:15:54.409061 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:54.408353 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xnt59" event={"ID":"83169317-50c1-49f2-b371-b9773e8c3b77","Type":"ContainerDied","Data":"5a417ee56e42cf6afba5d19cc42df6c663d2cbc6d286735f9461bb3855748dfc"} Nov 04 07:15:55.415680 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:55.415646 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xnt59" event={"ID":"83169317-50c1-49f2-b371-b9773e8c3b77","Type":"ContainerStarted","Data":"203f0ca14e8f9f467a506e772560389aa1a52ef67ee4e38d5068a27267a702ae"} Nov 04 07:15:55.416107 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:55.415706 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xnt59" event={"ID":"83169317-50c1-49f2-b371-b9773e8c3b77","Type":"ContainerStarted","Data":"1a9160543fe7108a389b5db0901c79ad3106a8a5bcf102385e5896ba83084f39"} Nov 04 07:15:55.441810 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:15:55.441766 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xnt59" podStartSLOduration=2.853786759 podStartE2EDuration="4.4417511s" totalImagesPullingTime="1.501625393s" totalInitContainerRuntime="86.338948ms" isStatefulPod=true podCreationTimestamp="2026-11-04 07:15:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:15:55.440021849 +0000 UTC m=+29.422650040" watchObservedRunningTime="2026-11-04 07:15:55.4417511 +0000 UTC m=+29.424379331" Nov 04 07:16:01.446142 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:01.446079 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-zgqlr" event={"ID":"b214cd37-e13b-4d6e-8550-7b43b7abe4c5","Type":"ContainerStarted","Data":"3ca75ba38c63f9e7fe6fa70116205d6a144cff39a5c22fc736feeeb59161405b"} Nov 04 07:16:01.446636 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:01.446612 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-zgqlr" Nov 04 07:16:01.462265 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:01.462237 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-zgqlr" Nov 04 07:16:01.475088 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:01.475042 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/downloads-6dd789c8b7-zgqlr" podStartSLOduration=1.8744223880000002 podStartE2EDuration="18.475029266s" totalImagesPullingTime="16.600606878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:16:01.472806577 +0000 UTC m=+35.455434770" watchObservedRunningTime="2026-11-04 07:16:01.475029266 +0000 UTC m=+35.457657455" Nov 04 07:16:01.773431 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:01.773359 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rq9pn" Nov 04 07:16:06.371240 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:06.371209 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-bdf74958f-jbtcn" Nov 04 07:16:06.447949 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:06.447913 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85f5799855-6xlbc"] Nov 04 07:16:08.709140 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:08.709012 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" podUID="aaff7a50-eb36-414b-a45e-5a0a56e3a8eb" containerName="registry" containerID="cri-o://cddc52f4b34a602bb12d1be490b82ec568c838e8665c5246f4aea9b7a31ee884" gracePeriod=30 Nov 04 07:16:09.015882 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.015837 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:16:09.093523 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.093494 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-kube-api-access-9tjsb\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-kube-api-access-9tjsb\") pod \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " Nov 04 07:16:09.093698 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.093594 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-tls\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-tls\") pod \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " Nov 04 07:16:09.093698 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.093627 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-installation-pull-secrets\") pod \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " Nov 04 07:16:09.093698 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.093669 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-ca-trust-extracted\") pod \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " Nov 04 07:16:09.094819 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.094127 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-trusted-ca\") pod \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " Nov 04 07:16:09.094819 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.094230 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-bound-sa-token\") pod \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " Nov 04 07:16:09.094819 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.094302 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-certificates\") pod \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " Nov 04 07:16:09.094819 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.094354 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-image-registry-private-configuration\") pod \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\" (UID: \"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb\") " Nov 04 07:16:09.094819 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.094651 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-trusted-ca" pod "aaff7a50-eb36-414b-a45e-5a0a56e3a8eb" (UID: "aaff7a50-eb36-414b-a45e-5a0a56e3a8eb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 07:16:09.095362 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.095323 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-certificates" pod "aaff7a50-eb36-414b-a45e-5a0a56e3a8eb" (UID: "aaff7a50-eb36-414b-a45e-5a0a56e3a8eb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 07:16:09.096804 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.096775 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-tls" pod "aaff7a50-eb36-414b-a45e-5a0a56e3a8eb" (UID: "aaff7a50-eb36-414b-a45e-5a0a56e3a8eb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:16:09.097479 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.097438 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-kube-api-access-9tjsb" pod "aaff7a50-eb36-414b-a45e-5a0a56e3a8eb" (UID: "aaff7a50-eb36-414b-a45e-5a0a56e3a8eb"). InnerVolumeSpecName "kube-api-access-9tjsb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:16:09.097662 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.097632 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-image-registry-private-configuration" pod "aaff7a50-eb36-414b-a45e-5a0a56e3a8eb" (UID: "aaff7a50-eb36-414b-a45e-5a0a56e3a8eb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 07:16:09.097826 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.097708 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-bound-sa-token" pod "aaff7a50-eb36-414b-a45e-5a0a56e3a8eb" (UID: "aaff7a50-eb36-414b-a45e-5a0a56e3a8eb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:16:09.097991 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.097951 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-installation-pull-secrets" pod "aaff7a50-eb36-414b-a45e-5a0a56e3a8eb" (UID: "aaff7a50-eb36-414b-a45e-5a0a56e3a8eb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 07:16:09.103116 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.102977 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-ca-trust-extracted" pod "aaff7a50-eb36-414b-a45e-5a0a56e3a8eb" (UID: "aaff7a50-eb36-414b-a45e-5a0a56e3a8eb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:16:09.195813 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.195784 5030 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-trusted-ca\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:16:09.195813 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.195810 5030 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-bound-sa-token\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:16:09.195952 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.195826 5030 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-certificates\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:16:09.195952 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.195843 5030 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-image-registry-private-configuration\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:16:09.195952 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.195854 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tjsb\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-kube-api-access-9tjsb\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:16:09.195952 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.195863 5030 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-registry-tls\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:16:09.195952 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.195876 5030 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-installation-pull-secrets\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:16:09.195952 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.195891 5030 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb-ca-trust-extracted\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:16:09.499462 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.499419 5030 generic.go:356] "Generic (PLEG): container finished" podID="aaff7a50-eb36-414b-a45e-5a0a56e3a8eb" containerID="cddc52f4b34a602bb12d1be490b82ec568c838e8665c5246f4aea9b7a31ee884" exitCode=0 Nov 04 07:16:09.499641 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.499527 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" Nov 04 07:16:09.499641 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.499527 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" event={"ID":"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb","Type":"ContainerDied","Data":"cddc52f4b34a602bb12d1be490b82ec568c838e8665c5246f4aea9b7a31ee884"} Nov 04 07:16:09.499641 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.499618 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67f4948c94-mmrkw" event={"ID":"aaff7a50-eb36-414b-a45e-5a0a56e3a8eb","Type":"ContainerDied","Data":"2b0181a98796863a42699203cd2d9b36cf9ba870c605c702233bdf042da41c3a"} Nov 04 07:16:09.499789 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.499644 5030 scope.go:122] "RemoveContainer" containerID="cddc52f4b34a602bb12d1be490b82ec568c838e8665c5246f4aea9b7a31ee884" Nov 04 07:16:09.509713 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.509697 5030 scope.go:122] "RemoveContainer" containerID="cddc52f4b34a602bb12d1be490b82ec568c838e8665c5246f4aea9b7a31ee884" Nov 04 07:16:09.509980 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:16:09.509950 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cddc52f4b34a602bb12d1be490b82ec568c838e8665c5246f4aea9b7a31ee884\": container with ID starting with cddc52f4b34a602bb12d1be490b82ec568c838e8665c5246f4aea9b7a31ee884 not found: ID does not exist" containerID="cddc52f4b34a602bb12d1be490b82ec568c838e8665c5246f4aea9b7a31ee884" Nov 04 07:16:09.510048 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.509985 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cddc52f4b34a602bb12d1be490b82ec568c838e8665c5246f4aea9b7a31ee884"} err="failed to get container status \"cddc52f4b34a602bb12d1be490b82ec568c838e8665c5246f4aea9b7a31ee884\": rpc error: code = NotFound desc = could not find container \"cddc52f4b34a602bb12d1be490b82ec568c838e8665c5246f4aea9b7a31ee884\": container with ID starting with cddc52f4b34a602bb12d1be490b82ec568c838e8665c5246f4aea9b7a31ee884 not found: ID does not exist" Nov 04 07:16:09.523593 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.523566 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67f4948c94-mmrkw"] Nov 04 07:16:09.527370 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:09.527348 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67f4948c94-mmrkw"] Nov 04 07:16:10.143069 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:10.143038 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aaff7a50-eb36-414b-a45e-5a0a56e3a8eb" path="/var/lib/kubelet/pods/aaff7a50-eb36-414b-a45e-5a0a56e3a8eb/volumes" Nov 04 07:16:22.139593 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:16:22.139556 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:16:30.589042 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:30.588978 5030 generic.go:356] "Generic (PLEG): container finished" podID="9f9af642-8ada-4711-b1d1-e6b086e6b16c" containerID="a840f298ffcbaa0aec7209ed1d70fbdd7f983ce01a8d873e0340ac36d867859b" exitCode=0 Nov 04 07:16:30.589414 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:30.589053 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw" event={"ID":"9f9af642-8ada-4711-b1d1-e6b086e6b16c","Type":"ContainerDied","Data":"a840f298ffcbaa0aec7209ed1d70fbdd7f983ce01a8d873e0340ac36d867859b"} Nov 04 07:16:30.589455 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:30.589415 5030 scope.go:122] "RemoveContainer" containerID="a840f298ffcbaa0aec7209ed1d70fbdd7f983ce01a8d873e0340ac36d867859b" Nov 04 07:16:31.477053 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.477007 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-85f5799855-6xlbc" podUID="fb5b977d-e13b-4499-8f7d-57b96f1b62bb" containerName="registry" containerID="cri-o://42978db2a2d91c61fd7872b322fcc7840d1763aebcdb8ad54d626ab4eb67a238" gracePeriod=30 Nov 04 07:16:31.594753 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.594728 5030 generic.go:356] "Generic (PLEG): container finished" podID="fb5b977d-e13b-4499-8f7d-57b96f1b62bb" containerID="42978db2a2d91c61fd7872b322fcc7840d1763aebcdb8ad54d626ab4eb67a238" exitCode=0 Nov 04 07:16:31.595111 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.594805 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85f5799855-6xlbc" event={"ID":"fb5b977d-e13b-4499-8f7d-57b96f1b62bb","Type":"ContainerDied","Data":"42978db2a2d91c61fd7872b322fcc7840d1763aebcdb8ad54d626ab4eb67a238"} Nov 04 07:16:31.596598 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.596580 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-qvdsw" event={"ID":"9f9af642-8ada-4711-b1d1-e6b086e6b16c","Type":"ContainerStarted","Data":"1f9680734988948046fbf64d9b1935de2c45f82ebd0ba09b48f0c4ca4b2ed52f"} Nov 04 07:16:31.760181 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.760156 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:16:31.854349 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.854317 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-bound-sa-token\") pod \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " Nov 04 07:16:31.854505 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.854366 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-ca-trust-extracted\") pod \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " Nov 04 07:16:31.854505 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.854407 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-kube-api-access-mknjr\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-kube-api-access-mknjr\") pod \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " Nov 04 07:16:31.854505 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.854445 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-tls\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-tls\") pod \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " Nov 04 07:16:31.854505 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.854487 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-installation-pull-secrets\") pod \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " Nov 04 07:16:31.854717 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.854520 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-image-registry-private-configuration\") pod \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " Nov 04 07:16:31.854717 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.854574 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-trusted-ca\") pod \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " Nov 04 07:16:31.854717 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.854656 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-certificates\") pod \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\" (UID: \"fb5b977d-e13b-4499-8f7d-57b96f1b62bb\") " Nov 04 07:16:31.855150 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.855011 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-trusted-ca" pod "fb5b977d-e13b-4499-8f7d-57b96f1b62bb" (UID: "fb5b977d-e13b-4499-8f7d-57b96f1b62bb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 07:16:31.855298 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.855227 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-certificates" pod "fb5b977d-e13b-4499-8f7d-57b96f1b62bb" (UID: "fb5b977d-e13b-4499-8f7d-57b96f1b62bb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 07:16:31.856777 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.856730 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-bound-sa-token" pod "fb5b977d-e13b-4499-8f7d-57b96f1b62bb" (UID: "fb5b977d-e13b-4499-8f7d-57b96f1b62bb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:16:31.856901 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.856829 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-image-registry-private-configuration" pod "fb5b977d-e13b-4499-8f7d-57b96f1b62bb" (UID: "fb5b977d-e13b-4499-8f7d-57b96f1b62bb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 07:16:31.857001 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.856981 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-kube-api-access-mknjr" pod "fb5b977d-e13b-4499-8f7d-57b96f1b62bb" (UID: "fb5b977d-e13b-4499-8f7d-57b96f1b62bb"). InnerVolumeSpecName "kube-api-access-mknjr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:16:31.857210 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.857188 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-installation-pull-secrets" pod "fb5b977d-e13b-4499-8f7d-57b96f1b62bb" (UID: "fb5b977d-e13b-4499-8f7d-57b96f1b62bb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 07:16:31.857303 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.857221 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-tls" pod "fb5b977d-e13b-4499-8f7d-57b96f1b62bb" (UID: "fb5b977d-e13b-4499-8f7d-57b96f1b62bb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:16:31.861431 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.861409 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-ca-trust-extracted" pod "fb5b977d-e13b-4499-8f7d-57b96f1b62bb" (UID: "fb5b977d-e13b-4499-8f7d-57b96f1b62bb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:16:31.955833 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.955808 5030 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-certificates\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:16:31.955833 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.955830 5030 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-bound-sa-token\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:16:31.955962 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.955839 5030 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-ca-trust-extracted\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:16:31.955962 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.955849 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mknjr\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-kube-api-access-mknjr\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:16:31.955962 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.955859 5030 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-registry-tls\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:16:31.955962 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.955867 5030 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-installation-pull-secrets\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:16:31.955962 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.955877 5030 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-image-registry-private-configuration\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:16:31.955962 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:31.955886 5030 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb5b977d-e13b-4499-8f7d-57b96f1b62bb-trusted-ca\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:16:32.601758 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:32.601730 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85f5799855-6xlbc" Nov 04 07:16:32.602186 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:32.601733 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85f5799855-6xlbc" event={"ID":"fb5b977d-e13b-4499-8f7d-57b96f1b62bb","Type":"ContainerDied","Data":"a95570c014cc92e7386eb5202888346a1568eec29bc360b5020f407f36759684"} Nov 04 07:16:32.602186 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:32.601860 5030 scope.go:122] "RemoveContainer" containerID="42978db2a2d91c61fd7872b322fcc7840d1763aebcdb8ad54d626ab4eb67a238" Nov 04 07:16:32.627225 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:32.627194 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85f5799855-6xlbc"] Nov 04 07:16:32.631223 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:32.631202 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-85f5799855-6xlbc"] Nov 04 07:16:34.143406 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:34.143372 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fb5b977d-e13b-4499-8f7d-57b96f1b62bb" path="/var/lib/kubelet/pods/fb5b977d-e13b-4499-8f7d-57b96f1b62bb/volumes" Nov 04 07:16:44.650903 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:44.650869 5030 generic.go:356] "Generic (PLEG): container finished" podID="8949591f-9c25-4e76-a673-67eb381ea2e0" containerID="7be7c9c850a08d03d3263c6c8fe1b28b69d9706905a0c035e2856117d7b3fbf1" exitCode=0 Nov 04 07:16:44.651217 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:44.650936 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-twnww-hrp7j" event={"ID":"8949591f-9c25-4e76-a673-67eb381ea2e0","Type":"ContainerDied","Data":"7be7c9c850a08d03d3263c6c8fe1b28b69d9706905a0c035e2856117d7b3fbf1"} Nov 04 07:16:45.776444 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:45.776419 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-twnww-hrp7j" Nov 04 07:16:45.856959 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:45.856936 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8949591f-9c25-4e76-a673-67eb381ea2e0-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/8949591f-9c25-4e76-a673-67eb381ea2e0-archives-path\") pod \"8949591f-9c25-4e76-a673-67eb381ea2e0\" (UID: \"8949591f-9c25-4e76-a673-67eb381ea2e0\") " Nov 04 07:16:45.857085 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:45.857008 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8949591f-9c25-4e76-a673-67eb381ea2e0-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8949591f-9c25-4e76-a673-67eb381ea2e0-service-ca-bundle\") pod \"8949591f-9c25-4e76-a673-67eb381ea2e0\" (UID: \"8949591f-9c25-4e76-a673-67eb381ea2e0\") " Nov 04 07:16:45.857085 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:45.857037 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8949591f-9c25-4e76-a673-67eb381ea2e0-kube-api-access-hmgtx\" (UniqueName: \"kubernetes.io/projected/8949591f-9c25-4e76-a673-67eb381ea2e0-kube-api-access-hmgtx\") pod \"8949591f-9c25-4e76-a673-67eb381ea2e0\" (UID: \"8949591f-9c25-4e76-a673-67eb381ea2e0\") " Nov 04 07:16:45.857085 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:45.857060 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8949591f-9c25-4e76-a673-67eb381ea2e0-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8949591f-9c25-4e76-a673-67eb381ea2e0-trusted-ca-bundle\") pod \"8949591f-9c25-4e76-a673-67eb381ea2e0\" (UID: \"8949591f-9c25-4e76-a673-67eb381ea2e0\") " Nov 04 07:16:45.857309 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:45.857282 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8949591f-9c25-4e76-a673-67eb381ea2e0-archives-path" pod "8949591f-9c25-4e76-a673-67eb381ea2e0" (UID: "8949591f-9c25-4e76-a673-67eb381ea2e0"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:16:45.857428 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:45.857405 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8949591f-9c25-4e76-a673-67eb381ea2e0-service-ca-bundle" pod "8949591f-9c25-4e76-a673-67eb381ea2e0" (UID: "8949591f-9c25-4e76-a673-67eb381ea2e0"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 07:16:45.857488 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:45.857469 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8949591f-9c25-4e76-a673-67eb381ea2e0-trusted-ca-bundle" pod "8949591f-9c25-4e76-a673-67eb381ea2e0" (UID: "8949591f-9c25-4e76-a673-67eb381ea2e0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 07:16:45.859287 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:45.859265 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8949591f-9c25-4e76-a673-67eb381ea2e0-kube-api-access-hmgtx" pod "8949591f-9c25-4e76-a673-67eb381ea2e0" (UID: "8949591f-9c25-4e76-a673-67eb381ea2e0"). InnerVolumeSpecName "kube-api-access-hmgtx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:16:45.957931 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:45.957908 5030 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/8949591f-9c25-4e76-a673-67eb381ea2e0-archives-path\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:16:45.957931 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:45.957930 5030 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8949591f-9c25-4e76-a673-67eb381ea2e0-service-ca-bundle\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:16:45.958066 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:45.957941 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmgtx\" (UniqueName: \"kubernetes.io/projected/8949591f-9c25-4e76-a673-67eb381ea2e0-kube-api-access-hmgtx\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:16:45.958066 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:45.957951 5030 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8949591f-9c25-4e76-a673-67eb381ea2e0-trusted-ca-bundle\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:16:46.660218 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:46.660189 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-twnww-hrp7j" Nov 04 07:16:46.660377 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:46.660216 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-twnww-hrp7j" event={"ID":"8949591f-9c25-4e76-a673-67eb381ea2e0","Type":"ContainerDied","Data":"454bb0b6dc7eb00960bf4110c14de7dfae55c00d2d3f22abe5a84e5787be7156"} Nov 04 07:16:46.660377 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:16:46.660258 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="454bb0b6dc7eb00960bf4110c14de7dfae55c00d2d3f22abe5a84e5787be7156" Nov 04 07:16:52.141221 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:16:52.141181 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:17:00.718254 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:00.718223 5030 generic.go:356] "Generic (PLEG): container finished" podID="a1971526-e34c-4dd8-9c6c-b6d9d13356c1" containerID="276304327ed1679129ff70fd45e5ae32c679fa74617b15d0a3289541c00ce05b" exitCode=0 Nov 04 07:17:00.718605 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:00.718299 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-p5lnr" event={"ID":"a1971526-e34c-4dd8-9c6c-b6d9d13356c1","Type":"ContainerDied","Data":"276304327ed1679129ff70fd45e5ae32c679fa74617b15d0a3289541c00ce05b"} Nov 04 07:17:00.718694 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:00.718614 5030 scope.go:122] "RemoveContainer" containerID="276304327ed1679129ff70fd45e5ae32c679fa74617b15d0a3289541c00ce05b" Nov 04 07:17:01.145967 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.145933 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-r94v5-lqsc7"] Nov 04 07:17:01.146312 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.146293 5030 cpu_manager.go:414] "containerMap: removing container" podUID="8949591f-9c25-4e76-a673-67eb381ea2e0" containerName="insights-gathering" Nov 04 07:17:01.146408 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.146313 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8949591f-9c25-4e76-a673-67eb381ea2e0" containerName="insights-gathering" Nov 04 07:17:01.146408 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.146350 5030 cpu_manager.go:414] "containerMap: removing container" podUID="aaff7a50-eb36-414b-a45e-5a0a56e3a8eb" containerName="registry" Nov 04 07:17:01.146408 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.146356 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aaff7a50-eb36-414b-a45e-5a0a56e3a8eb" containerName="registry" Nov 04 07:17:01.146408 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.146377 5030 cpu_manager.go:414] "containerMap: removing container" podUID="fb5b977d-e13b-4499-8f7d-57b96f1b62bb" containerName="registry" Nov 04 07:17:01.146408 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.146384 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fb5b977d-e13b-4499-8f7d-57b96f1b62bb" containerName="registry" Nov 04 07:17:01.146627 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.146462 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="aaff7a50-eb36-414b-a45e-5a0a56e3a8eb" containerName="registry" Nov 04 07:17:01.146627 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.146477 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="fb5b977d-e13b-4499-8f7d-57b96f1b62bb" containerName="registry" Nov 04 07:17:01.146627 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.146483 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="8949591f-9c25-4e76-a673-67eb381ea2e0" containerName="insights-gathering" Nov 04 07:17:01.148534 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.148507 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-r94v5-lqsc7" Nov 04 07:17:01.161678 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.161652 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-r94v5-lqsc7"] Nov 04 07:17:01.267228 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.267193 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a62d2d12-a53b-4493-8268-837be0d5bf17-trusted-ca-bundle\") pod \"periodic-gathering-r94v5-lqsc7\" (UID: \"a62d2d12-a53b-4493-8268-837be0d5bf17\") " pod="openshift-insights/periodic-gathering-r94v5-lqsc7" Nov 04 07:17:01.267403 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.267238 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/a62d2d12-a53b-4493-8268-837be0d5bf17-archives-path\") pod \"periodic-gathering-r94v5-lqsc7\" (UID: \"a62d2d12-a53b-4493-8268-837be0d5bf17\") " pod="openshift-insights/periodic-gathering-r94v5-lqsc7" Nov 04 07:17:01.267403 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.267334 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bh42\" (UniqueName: \"kubernetes.io/projected/a62d2d12-a53b-4493-8268-837be0d5bf17-kube-api-access-2bh42\") pod \"periodic-gathering-r94v5-lqsc7\" (UID: \"a62d2d12-a53b-4493-8268-837be0d5bf17\") " pod="openshift-insights/periodic-gathering-r94v5-lqsc7" Nov 04 07:17:01.267403 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.267388 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a62d2d12-a53b-4493-8268-837be0d5bf17-service-ca-bundle\") pod \"periodic-gathering-r94v5-lqsc7\" (UID: \"a62d2d12-a53b-4493-8268-837be0d5bf17\") " pod="openshift-insights/periodic-gathering-r94v5-lqsc7" Nov 04 07:17:01.368440 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.368400 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a62d2d12-a53b-4493-8268-837be0d5bf17-service-ca-bundle\") pod \"periodic-gathering-r94v5-lqsc7\" (UID: \"a62d2d12-a53b-4493-8268-837be0d5bf17\") " pod="openshift-insights/periodic-gathering-r94v5-lqsc7" Nov 04 07:17:01.368591 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.368469 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a62d2d12-a53b-4493-8268-837be0d5bf17-trusted-ca-bundle\") pod \"periodic-gathering-r94v5-lqsc7\" (UID: \"a62d2d12-a53b-4493-8268-837be0d5bf17\") " pod="openshift-insights/periodic-gathering-r94v5-lqsc7" Nov 04 07:17:01.368591 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.368497 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/a62d2d12-a53b-4493-8268-837be0d5bf17-archives-path\") pod \"periodic-gathering-r94v5-lqsc7\" (UID: \"a62d2d12-a53b-4493-8268-837be0d5bf17\") " pod="openshift-insights/periodic-gathering-r94v5-lqsc7" Nov 04 07:17:01.368591 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.368520 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bh42\" (UniqueName: \"kubernetes.io/projected/a62d2d12-a53b-4493-8268-837be0d5bf17-kube-api-access-2bh42\") pod \"periodic-gathering-r94v5-lqsc7\" (UID: \"a62d2d12-a53b-4493-8268-837be0d5bf17\") " pod="openshift-insights/periodic-gathering-r94v5-lqsc7" Nov 04 07:17:01.368935 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.368908 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/a62d2d12-a53b-4493-8268-837be0d5bf17-archives-path\") pod \"periodic-gathering-r94v5-lqsc7\" (UID: \"a62d2d12-a53b-4493-8268-837be0d5bf17\") " pod="openshift-insights/periodic-gathering-r94v5-lqsc7" Nov 04 07:17:01.369218 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.369200 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a62d2d12-a53b-4493-8268-837be0d5bf17-service-ca-bundle\") pod \"periodic-gathering-r94v5-lqsc7\" (UID: \"a62d2d12-a53b-4493-8268-837be0d5bf17\") " pod="openshift-insights/periodic-gathering-r94v5-lqsc7" Nov 04 07:17:01.369321 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.369304 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a62d2d12-a53b-4493-8268-837be0d5bf17-trusted-ca-bundle\") pod \"periodic-gathering-r94v5-lqsc7\" (UID: \"a62d2d12-a53b-4493-8268-837be0d5bf17\") " pod="openshift-insights/periodic-gathering-r94v5-lqsc7" Nov 04 07:17:01.381243 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.381218 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bh42\" (UniqueName: \"kubernetes.io/projected/a62d2d12-a53b-4493-8268-837be0d5bf17-kube-api-access-2bh42\") pod \"periodic-gathering-r94v5-lqsc7\" (UID: \"a62d2d12-a53b-4493-8268-837be0d5bf17\") " pod="openshift-insights/periodic-gathering-r94v5-lqsc7" Nov 04 07:17:01.460320 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.460296 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-r94v5-lqsc7" Nov 04 07:17:01.724489 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.724421 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-p5lnr" event={"ID":"a1971526-e34c-4dd8-9c6c-b6d9d13356c1","Type":"ContainerStarted","Data":"8d05325c3786cea921c0b2bf118b706f355a8da7dc373efb00b583affb4cf275"} Nov 04 07:17:01.731240 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:01.731214 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-r94v5-lqsc7"] Nov 04 07:17:01.733782 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:17:01.733759 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda62d2d12_a53b_4493_8268_837be0d5bf17.slice/crio-a41ca3a449f8658f4b92cbb219d74239af7726e014a4e3b2369bdeb316a6e7a3 WatchSource:0}: Error finding container a41ca3a449f8658f4b92cbb219d74239af7726e014a4e3b2369bdeb316a6e7a3: Status 404 returned error can't find the container with id a41ca3a449f8658f4b92cbb219d74239af7726e014a4e3b2369bdeb316a6e7a3 Nov 04 07:17:02.730049 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:02.730007 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-r94v5-lqsc7" event={"ID":"a62d2d12-a53b-4493-8268-837be0d5bf17","Type":"ContainerStarted","Data":"a754971a3bfa22523f64762993572ec4edbe0a6f314f5368ff52fbb90febd06e"} Nov 04 07:17:02.730561 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:02.730073 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-r94v5-lqsc7" event={"ID":"a62d2d12-a53b-4493-8268-837be0d5bf17","Type":"ContainerStarted","Data":"a41ca3a449f8658f4b92cbb219d74239af7726e014a4e3b2369bdeb316a6e7a3"} Nov 04 07:17:02.748943 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:17:02.748900 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-r94v5-lqsc7" podStartSLOduration=1.748887809 podStartE2EDuration="1.748887809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:17:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:17:02.748095382 +0000 UTC m=+96.730723589" watchObservedRunningTime="2026-11-04 07:17:02.748887809 +0000 UTC m=+96.731516002" Nov 04 07:17:22.140462 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:17:22.140420 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:17:52.139848 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:17:52.139760 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:18:22.142092 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:18:22.142052 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:18:26.075497 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:18:26.075459 5030 generic.go:356] "Generic (PLEG): container finished" podID="a62d2d12-a53b-4493-8268-837be0d5bf17" containerID="a754971a3bfa22523f64762993572ec4edbe0a6f314f5368ff52fbb90febd06e" exitCode=0 Nov 04 07:18:26.075921 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:18:26.075531 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-r94v5-lqsc7" event={"ID":"a62d2d12-a53b-4493-8268-837be0d5bf17","Type":"ContainerDied","Data":"a754971a3bfa22523f64762993572ec4edbe0a6f314f5368ff52fbb90febd06e"} Nov 04 07:18:27.209021 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:18:27.208999 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-r94v5-lqsc7" Nov 04 07:18:27.290727 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:18:27.290695 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a62d2d12-a53b-4493-8268-837be0d5bf17-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a62d2d12-a53b-4493-8268-837be0d5bf17-service-ca-bundle\") pod \"a62d2d12-a53b-4493-8268-837be0d5bf17\" (UID: \"a62d2d12-a53b-4493-8268-837be0d5bf17\") " Nov 04 07:18:27.290843 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:18:27.290764 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a62d2d12-a53b-4493-8268-837be0d5bf17-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a62d2d12-a53b-4493-8268-837be0d5bf17-trusted-ca-bundle\") pod \"a62d2d12-a53b-4493-8268-837be0d5bf17\" (UID: \"a62d2d12-a53b-4493-8268-837be0d5bf17\") " Nov 04 07:18:27.290843 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:18:27.290791 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a62d2d12-a53b-4493-8268-837be0d5bf17-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/a62d2d12-a53b-4493-8268-837be0d5bf17-archives-path\") pod \"a62d2d12-a53b-4493-8268-837be0d5bf17\" (UID: \"a62d2d12-a53b-4493-8268-837be0d5bf17\") " Nov 04 07:18:27.290921 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:18:27.290854 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a62d2d12-a53b-4493-8268-837be0d5bf17-kube-api-access-2bh42\" (UniqueName: \"kubernetes.io/projected/a62d2d12-a53b-4493-8268-837be0d5bf17-kube-api-access-2bh42\") pod \"a62d2d12-a53b-4493-8268-837be0d5bf17\" (UID: \"a62d2d12-a53b-4493-8268-837be0d5bf17\") " Nov 04 07:18:27.291180 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:18:27.291151 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a62d2d12-a53b-4493-8268-837be0d5bf17-trusted-ca-bundle" pod "a62d2d12-a53b-4493-8268-837be0d5bf17" (UID: "a62d2d12-a53b-4493-8268-837be0d5bf17"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 07:18:27.291234 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:18:27.291177 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a62d2d12-a53b-4493-8268-837be0d5bf17-service-ca-bundle" pod "a62d2d12-a53b-4493-8268-837be0d5bf17" (UID: "a62d2d12-a53b-4493-8268-837be0d5bf17"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 07:18:27.291234 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:18:27.291185 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a62d2d12-a53b-4493-8268-837be0d5bf17-archives-path" pod "a62d2d12-a53b-4493-8268-837be0d5bf17" (UID: "a62d2d12-a53b-4493-8268-837be0d5bf17"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:18:27.292782 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:18:27.292762 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a62d2d12-a53b-4493-8268-837be0d5bf17-kube-api-access-2bh42" pod "a62d2d12-a53b-4493-8268-837be0d5bf17" (UID: "a62d2d12-a53b-4493-8268-837be0d5bf17"). InnerVolumeSpecName "kube-api-access-2bh42". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:18:27.392156 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:18:27.392086 5030 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a62d2d12-a53b-4493-8268-837be0d5bf17-service-ca-bundle\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:18:27.392156 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:18:27.392106 5030 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a62d2d12-a53b-4493-8268-837be0d5bf17-trusted-ca-bundle\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:18:27.392156 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:18:27.392123 5030 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/a62d2d12-a53b-4493-8268-837be0d5bf17-archives-path\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:18:27.392156 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:18:27.392148 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bh42\" (UniqueName: \"kubernetes.io/projected/a62d2d12-a53b-4493-8268-837be0d5bf17-kube-api-access-2bh42\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:18:28.085082 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:18:28.085046 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-r94v5-lqsc7" Nov 04 07:18:28.085266 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:18:28.085080 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-r94v5-lqsc7" event={"ID":"a62d2d12-a53b-4493-8268-837be0d5bf17","Type":"ContainerDied","Data":"a41ca3a449f8658f4b92cbb219d74239af7726e014a4e3b2369bdeb316a6e7a3"} Nov 04 07:18:28.085266 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:18:28.085152 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a41ca3a449f8658f4b92cbb219d74239af7726e014a4e3b2369bdeb316a6e7a3" Nov 04 07:18:52.145860 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:18:52.140571 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:19:22.141292 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:19:22.141254 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:19:28.912687 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:28.912652 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5"] Nov 04 07:19:28.913100 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:28.912963 5030 cpu_manager.go:414] "containerMap: removing container" podUID="a62d2d12-a53b-4493-8268-837be0d5bf17" containerName="insights-gathering" Nov 04 07:19:28.913100 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:28.912973 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a62d2d12-a53b-4493-8268-837be0d5bf17" containerName="insights-gathering" Nov 04 07:19:28.913100 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:28.913043 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="a62d2d12-a53b-4493-8268-837be0d5bf17" containerName="insights-gathering" Nov 04 07:19:28.916171 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:28.916153 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5" Nov 04 07:19:28.921097 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:28.921076 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Nov 04 07:19:28.921231 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:28.921176 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Nov 04 07:19:28.921231 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:28.921179 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-kp896\"" Nov 04 07:19:28.925775 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:28.925751 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5"] Nov 04 07:19:29.025184 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.025153 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/865d5bc1-5cf3-4725-9b5a-46201f263d64-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5\" (UID: \"865d5bc1-5cf3-4725-9b5a-46201f263d64\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5" Nov 04 07:19:29.025348 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.025205 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k56w5\" (UniqueName: \"kubernetes.io/projected/865d5bc1-5cf3-4725-9b5a-46201f263d64-kube-api-access-k56w5\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5\" (UID: \"865d5bc1-5cf3-4725-9b5a-46201f263d64\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5" Nov 04 07:19:29.025348 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.025269 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/865d5bc1-5cf3-4725-9b5a-46201f263d64-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5\" (UID: \"865d5bc1-5cf3-4725-9b5a-46201f263d64\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5" Nov 04 07:19:29.126165 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.126122 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/865d5bc1-5cf3-4725-9b5a-46201f263d64-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5\" (UID: \"865d5bc1-5cf3-4725-9b5a-46201f263d64\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5" Nov 04 07:19:29.126285 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.126180 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k56w5\" (UniqueName: \"kubernetes.io/projected/865d5bc1-5cf3-4725-9b5a-46201f263d64-kube-api-access-k56w5\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5\" (UID: \"865d5bc1-5cf3-4725-9b5a-46201f263d64\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5" Nov 04 07:19:29.126285 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.126202 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/865d5bc1-5cf3-4725-9b5a-46201f263d64-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5\" (UID: \"865d5bc1-5cf3-4725-9b5a-46201f263d64\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5" Nov 04 07:19:29.126555 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.126531 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/865d5bc1-5cf3-4725-9b5a-46201f263d64-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5\" (UID: \"865d5bc1-5cf3-4725-9b5a-46201f263d64\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5" Nov 04 07:19:29.126620 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.126553 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/865d5bc1-5cf3-4725-9b5a-46201f263d64-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5\" (UID: \"865d5bc1-5cf3-4725-9b5a-46201f263d64\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5" Nov 04 07:19:29.139440 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.139419 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k56w5\" (UniqueName: \"kubernetes.io/projected/865d5bc1-5cf3-4725-9b5a-46201f263d64-kube-api-access-k56w5\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5\" (UID: \"865d5bc1-5cf3-4725-9b5a-46201f263d64\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5" Nov 04 07:19:29.232611 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.232592 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5" Nov 04 07:19:29.369629 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.369598 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859"] Nov 04 07:19:29.373074 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.373018 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.387227 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.387208 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Nov 04 07:19:29.391199 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.391183 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-vbfcx\"" Nov 04 07:19:29.394856 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.394831 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859"] Nov 04 07:19:29.515065 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.515007 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5"] Nov 04 07:19:29.518351 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:19:29.518325 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod865d5bc1_5cf3_4725_9b5a_46201f263d64.slice/crio-3d3690e64afd0aa3767a9553459dd296879df85c967a3779448de1af10185c22 WatchSource:0}: Error finding container 3d3690e64afd0aa3767a9553459dd296879df85c967a3779448de1af10185c22: Status 404 returned error can't find the container with id 3d3690e64afd0aa3767a9553459dd296879df85c967a3779448de1af10185c22 Nov 04 07:19:29.529749 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.529729 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d83d8983-692a-47e2-b13f-978cb25085e1-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.529847 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.529760 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d83d8983-692a-47e2-b13f-978cb25085e1-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.529847 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.529783 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d83d8983-692a-47e2-b13f-978cb25085e1-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.529960 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.529935 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d83d8983-692a-47e2-b13f-978cb25085e1-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.530024 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.529976 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d83d8983-692a-47e2-b13f-978cb25085e1-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.530096 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.530080 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49wbj\" (UniqueName: \"kubernetes.io/projected/d83d8983-692a-47e2-b13f-978cb25085e1-kube-api-access-49wbj\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.530172 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.530120 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d83d8983-692a-47e2-b13f-978cb25085e1-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.530220 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.530181 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d83d8983-692a-47e2-b13f-978cb25085e1-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.530220 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.530214 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d83d8983-692a-47e2-b13f-978cb25085e1-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.630972 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.630948 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d83d8983-692a-47e2-b13f-978cb25085e1-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.631067 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.630980 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d83d8983-692a-47e2-b13f-978cb25085e1-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.631067 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.631003 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d83d8983-692a-47e2-b13f-978cb25085e1-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.631067 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.631028 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d83d8983-692a-47e2-b13f-978cb25085e1-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.631257 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.631069 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d83d8983-692a-47e2-b13f-978cb25085e1-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.631257 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.631087 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d83d8983-692a-47e2-b13f-978cb25085e1-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.631257 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.631115 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49wbj\" (UniqueName: \"kubernetes.io/projected/d83d8983-692a-47e2-b13f-978cb25085e1-kube-api-access-49wbj\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.631411 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.631274 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d83d8983-692a-47e2-b13f-978cb25085e1-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.631411 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.631313 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d83d8983-692a-47e2-b13f-978cb25085e1-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.631508 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.631424 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d83d8983-692a-47e2-b13f-978cb25085e1-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.631567 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.631524 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d83d8983-692a-47e2-b13f-978cb25085e1-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.631638 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.631622 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d83d8983-692a-47e2-b13f-978cb25085e1-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.631701 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.631680 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d83d8983-692a-47e2-b13f-978cb25085e1-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.631877 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.631856 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d83d8983-692a-47e2-b13f-978cb25085e1-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.633367 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.633349 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d83d8983-692a-47e2-b13f-978cb25085e1-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.633620 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.633598 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d83d8983-692a-47e2-b13f-978cb25085e1-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.643141 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.643103 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d83d8983-692a-47e2-b13f-978cb25085e1-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.643333 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.643318 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49wbj\" (UniqueName: \"kubernetes.io/projected/d83d8983-692a-47e2-b13f-978cb25085e1-kube-api-access-49wbj\") pod \"openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859\" (UID: \"d83d8983-692a-47e2-b13f-978cb25085e1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.687196 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.687171 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:29.963727 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:29.963700 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859"] Nov 04 07:19:29.965949 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:19:29.965916 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd83d8983_692a_47e2_b13f_978cb25085e1.slice/crio-1a302a3ef23dc7a50bf5ed3719fa774d6363c8e95900b8dfad69e2d62263284c WatchSource:0}: Error finding container 1a302a3ef23dc7a50bf5ed3719fa774d6363c8e95900b8dfad69e2d62263284c: Status 404 returned error can't find the container with id 1a302a3ef23dc7a50bf5ed3719fa774d6363c8e95900b8dfad69e2d62263284c Nov 04 07:19:30.343977 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:30.343891 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" event={"ID":"d83d8983-692a-47e2-b13f-978cb25085e1","Type":"ContainerStarted","Data":"1a302a3ef23dc7a50bf5ed3719fa774d6363c8e95900b8dfad69e2d62263284c"} Nov 04 07:19:30.345199 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:30.345173 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5" event={"ID":"865d5bc1-5cf3-4725-9b5a-46201f263d64","Type":"ContainerStarted","Data":"3d3690e64afd0aa3767a9553459dd296879df85c967a3779448de1af10185c22"} Nov 04 07:19:33.390533 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:33.390496 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:19:33.390852 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:33.390568 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:19:33.390852 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:33.390598 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:19:34.376377 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:34.376334 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" event={"ID":"d83d8983-692a-47e2-b13f-978cb25085e1","Type":"ContainerStarted","Data":"9683dbb505bde40896941a1cdc8ede39347da3c9b374e2fa490223afabb67d8b"} Nov 04 07:19:34.402070 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:34.402024 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" podStartSLOduration=1.98302714 podStartE2EDuration="5.402010652s" totalImagesPullingTime="3.418983512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:19:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:19:34.400717087 +0000 UTC m=+248.383345275" watchObservedRunningTime="2026-11-04 07:19:34.402010652 +0000 UTC m=+248.384638823" Nov 04 07:19:34.687979 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:34.687943 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:34.693698 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:34.693672 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:35.382640 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:35.382614 5030 generic.go:356] "Generic (PLEG): container finished" podID="865d5bc1-5cf3-4725-9b5a-46201f263d64" containerID="e5b264eb058b61e3b2f217b44c71d84aa34af5f288745a8fcb95a5fe3f0ef305" exitCode=0 Nov 04 07:19:35.382752 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:35.382702 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5" event={"ID":"865d5bc1-5cf3-4725-9b5a-46201f263d64","Type":"ContainerDied","Data":"e5b264eb058b61e3b2f217b44c71d84aa34af5f288745a8fcb95a5fe3f0ef305"} Nov 04 07:19:35.382988 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:35.382966 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:35.383871 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:35.383853 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859" Nov 04 07:19:38.396602 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:38.396565 5030 generic.go:356] "Generic (PLEG): container finished" podID="865d5bc1-5cf3-4725-9b5a-46201f263d64" containerID="805f42d8f65d3adf4a97234e356c1f0a2033d9c7aa0cde206847a4fd8af5a823" exitCode=0 Nov 04 07:19:38.397051 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:38.396646 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5" event={"ID":"865d5bc1-5cf3-4725-9b5a-46201f263d64","Type":"ContainerDied","Data":"805f42d8f65d3adf4a97234e356c1f0a2033d9c7aa0cde206847a4fd8af5a823"} Nov 04 07:19:44.431116 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:44.431083 5030 generic.go:356] "Generic (PLEG): container finished" podID="865d5bc1-5cf3-4725-9b5a-46201f263d64" containerID="2047f6f23dfaf1222663e3c742aecde5fb927eb4e62e94547ddc3a36c098c732" exitCode=0 Nov 04 07:19:44.431476 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:44.431171 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5" event={"ID":"865d5bc1-5cf3-4725-9b5a-46201f263d64","Type":"ContainerDied","Data":"2047f6f23dfaf1222663e3c742aecde5fb927eb4e62e94547ddc3a36c098c732"} Nov 04 07:19:45.556314 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:45.556286 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5" Nov 04 07:19:45.558297 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:45.558274 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/865d5bc1-5cf3-4725-9b5a-46201f263d64-bundle\" (UniqueName: \"kubernetes.io/empty-dir/865d5bc1-5cf3-4725-9b5a-46201f263d64-bundle\") pod \"865d5bc1-5cf3-4725-9b5a-46201f263d64\" (UID: \"865d5bc1-5cf3-4725-9b5a-46201f263d64\") " Nov 04 07:19:45.558607 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:45.558586 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/865d5bc1-5cf3-4725-9b5a-46201f263d64-bundle" pod "865d5bc1-5cf3-4725-9b5a-46201f263d64" (UID: "865d5bc1-5cf3-4725-9b5a-46201f263d64"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:19:45.659296 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:45.659267 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/865d5bc1-5cf3-4725-9b5a-46201f263d64-kube-api-access-k56w5\" (UniqueName: \"kubernetes.io/projected/865d5bc1-5cf3-4725-9b5a-46201f263d64-kube-api-access-k56w5\") pod \"865d5bc1-5cf3-4725-9b5a-46201f263d64\" (UID: \"865d5bc1-5cf3-4725-9b5a-46201f263d64\") " Nov 04 07:19:45.659412 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:45.659362 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/865d5bc1-5cf3-4725-9b5a-46201f263d64-util\" (UniqueName: \"kubernetes.io/empty-dir/865d5bc1-5cf3-4725-9b5a-46201f263d64-util\") pod \"865d5bc1-5cf3-4725-9b5a-46201f263d64\" (UID: \"865d5bc1-5cf3-4725-9b5a-46201f263d64\") " Nov 04 07:19:45.659604 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:45.659585 5030 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/865d5bc1-5cf3-4725-9b5a-46201f263d64-bundle\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:19:45.661373 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:45.661351 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/865d5bc1-5cf3-4725-9b5a-46201f263d64-kube-api-access-k56w5" pod "865d5bc1-5cf3-4725-9b5a-46201f263d64" (UID: "865d5bc1-5cf3-4725-9b5a-46201f263d64"). InnerVolumeSpecName "kube-api-access-k56w5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:19:45.664430 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:45.664409 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/865d5bc1-5cf3-4725-9b5a-46201f263d64-util" pod "865d5bc1-5cf3-4725-9b5a-46201f263d64" (UID: "865d5bc1-5cf3-4725-9b5a-46201f263d64"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:19:45.760294 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:45.760238 5030 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/865d5bc1-5cf3-4725-9b5a-46201f263d64-util\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:19:45.760294 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:45.760263 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k56w5\" (UniqueName: \"kubernetes.io/projected/865d5bc1-5cf3-4725-9b5a-46201f263d64-kube-api-access-k56w5\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:19:46.441082 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:46.441048 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5" event={"ID":"865d5bc1-5cf3-4725-9b5a-46201f263d64","Type":"ContainerDied","Data":"3d3690e64afd0aa3767a9553459dd296879df85c967a3779448de1af10185c22"} Nov 04 07:19:46.441267 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:46.441091 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6445gzr5" Nov 04 07:19:46.441267 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:46.441095 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d3690e64afd0aa3767a9553459dd296879df85c967a3779448de1af10185c22" Nov 04 07:19:52.140846 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:19:52.140806 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:19:58.353530 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.353501 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl"] Nov 04 07:19:58.353893 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.353807 5030 cpu_manager.go:414] "containerMap: removing container" podUID="865d5bc1-5cf3-4725-9b5a-46201f263d64" containerName="util" Nov 04 07:19:58.353893 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.353818 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="865d5bc1-5cf3-4725-9b5a-46201f263d64" containerName="util" Nov 04 07:19:58.353893 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.353845 5030 cpu_manager.go:414] "containerMap: removing container" podUID="865d5bc1-5cf3-4725-9b5a-46201f263d64" containerName="extract" Nov 04 07:19:58.353893 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.353849 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="865d5bc1-5cf3-4725-9b5a-46201f263d64" containerName="extract" Nov 04 07:19:58.353893 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.353857 5030 cpu_manager.go:414] "containerMap: removing container" podUID="865d5bc1-5cf3-4725-9b5a-46201f263d64" containerName="pull" Nov 04 07:19:58.353893 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.353862 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="865d5bc1-5cf3-4725-9b5a-46201f263d64" containerName="pull" Nov 04 07:19:58.354086 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.353912 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="865d5bc1-5cf3-4725-9b5a-46201f263d64" containerName="extract" Nov 04 07:19:58.427002 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.426974 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl"] Nov 04 07:19:58.427175 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.427087 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" Nov 04 07:19:58.450789 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.450763 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef49e380-50e5-4bd6-8060-c21e81f84a9f-webhook-cert\") pod \"opendatahub-operator-controller-manager-8f94f88d4-klvcl\" (UID: \"ef49e380-50e5-4bd6-8060-c21e81f84a9f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" Nov 04 07:19:58.450898 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.450796 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef49e380-50e5-4bd6-8060-c21e81f84a9f-tmp\") pod \"opendatahub-operator-controller-manager-8f94f88d4-klvcl\" (UID: \"ef49e380-50e5-4bd6-8060-c21e81f84a9f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" Nov 04 07:19:58.450898 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.450822 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ef49e380-50e5-4bd6-8060-c21e81f84a9f-manifests\") pod \"opendatahub-operator-controller-manager-8f94f88d4-klvcl\" (UID: \"ef49e380-50e5-4bd6-8060-c21e81f84a9f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" Nov 04 07:19:58.450981 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.450886 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ef49e380-50e5-4bd6-8060-c21e81f84a9f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8f94f88d4-klvcl\" (UID: \"ef49e380-50e5-4bd6-8060-c21e81f84a9f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" Nov 04 07:19:58.450981 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.450932 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn4wd\" (UniqueName: \"kubernetes.io/projected/ef49e380-50e5-4bd6-8060-c21e81f84a9f-kube-api-access-fn4wd\") pod \"opendatahub-operator-controller-manager-8f94f88d4-klvcl\" (UID: \"ef49e380-50e5-4bd6-8060-c21e81f84a9f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" Nov 04 07:19:58.451051 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.451016 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef49e380-50e5-4bd6-8060-c21e81f84a9f-metrics-cert\") pod \"opendatahub-operator-controller-manager-8f94f88d4-klvcl\" (UID: \"ef49e380-50e5-4bd6-8060-c21e81f84a9f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" Nov 04 07:19:58.509738 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.509715 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Nov 04 07:19:58.509957 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.509930 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Nov 04 07:19:58.509957 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.509946 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Nov 04 07:19:58.510089 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.509970 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Nov 04 07:19:58.510089 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.509973 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-nhb6m\"" Nov 04 07:19:58.510089 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.510010 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Nov 04 07:19:58.551833 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.551809 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef49e380-50e5-4bd6-8060-c21e81f84a9f-tmp\") pod \"opendatahub-operator-controller-manager-8f94f88d4-klvcl\" (UID: \"ef49e380-50e5-4bd6-8060-c21e81f84a9f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" Nov 04 07:19:58.551921 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.551850 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ef49e380-50e5-4bd6-8060-c21e81f84a9f-manifests\") pod \"opendatahub-operator-controller-manager-8f94f88d4-klvcl\" (UID: \"ef49e380-50e5-4bd6-8060-c21e81f84a9f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" Nov 04 07:19:58.551921 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.551872 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ef49e380-50e5-4bd6-8060-c21e81f84a9f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8f94f88d4-klvcl\" (UID: \"ef49e380-50e5-4bd6-8060-c21e81f84a9f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" Nov 04 07:19:58.551921 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.551887 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn4wd\" (UniqueName: \"kubernetes.io/projected/ef49e380-50e5-4bd6-8060-c21e81f84a9f-kube-api-access-fn4wd\") pod \"opendatahub-operator-controller-manager-8f94f88d4-klvcl\" (UID: \"ef49e380-50e5-4bd6-8060-c21e81f84a9f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" Nov 04 07:19:58.551921 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.551911 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef49e380-50e5-4bd6-8060-c21e81f84a9f-metrics-cert\") pod \"opendatahub-operator-controller-manager-8f94f88d4-klvcl\" (UID: \"ef49e380-50e5-4bd6-8060-c21e81f84a9f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" Nov 04 07:19:58.552125 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.551968 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef49e380-50e5-4bd6-8060-c21e81f84a9f-webhook-cert\") pod \"opendatahub-operator-controller-manager-8f94f88d4-klvcl\" (UID: \"ef49e380-50e5-4bd6-8060-c21e81f84a9f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" Nov 04 07:19:58.552250 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.552230 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ef49e380-50e5-4bd6-8060-c21e81f84a9f-manifests\") pod \"opendatahub-operator-controller-manager-8f94f88d4-klvcl\" (UID: \"ef49e380-50e5-4bd6-8060-c21e81f84a9f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" Nov 04 07:19:58.554170 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.554128 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef49e380-50e5-4bd6-8060-c21e81f84a9f-tmp\") pod \"opendatahub-operator-controller-manager-8f94f88d4-klvcl\" (UID: \"ef49e380-50e5-4bd6-8060-c21e81f84a9f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" Nov 04 07:19:58.554306 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.554288 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef49e380-50e5-4bd6-8060-c21e81f84a9f-metrics-cert\") pod \"opendatahub-operator-controller-manager-8f94f88d4-klvcl\" (UID: \"ef49e380-50e5-4bd6-8060-c21e81f84a9f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" Nov 04 07:19:58.554414 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.554396 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef49e380-50e5-4bd6-8060-c21e81f84a9f-webhook-cert\") pod \"opendatahub-operator-controller-manager-8f94f88d4-klvcl\" (UID: \"ef49e380-50e5-4bd6-8060-c21e81f84a9f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" Nov 04 07:19:58.554612 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.554595 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ef49e380-50e5-4bd6-8060-c21e81f84a9f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8f94f88d4-klvcl\" (UID: \"ef49e380-50e5-4bd6-8060-c21e81f84a9f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" Nov 04 07:19:58.565195 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.565174 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn4wd\" (UniqueName: \"kubernetes.io/projected/ef49e380-50e5-4bd6-8060-c21e81f84a9f-kube-api-access-fn4wd\") pod \"opendatahub-operator-controller-manager-8f94f88d4-klvcl\" (UID: \"ef49e380-50e5-4bd6-8060-c21e81f84a9f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" Nov 04 07:19:58.773706 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:58.773671 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" Nov 04 07:19:59.089081 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:59.089046 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl"] Nov 04 07:19:59.090044 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:19:59.090008 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef49e380_50e5_4bd6_8060_c21e81f84a9f.slice/crio-250db15d63f3b512df2b13d3fbe4e40d5a640a1ce4568af20bc9d321bc9a70be WatchSource:0}: Error finding container 250db15d63f3b512df2b13d3fbe4e40d5a640a1ce4568af20bc9d321bc9a70be: Status 404 returned error can't find the container with id 250db15d63f3b512df2b13d3fbe4e40d5a640a1ce4568af20bc9d321bc9a70be Nov 04 07:19:59.495024 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:19:59.494997 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" event={"ID":"ef49e380-50e5-4bd6-8060-c21e81f84a9f","Type":"ContainerStarted","Data":"250db15d63f3b512df2b13d3fbe4e40d5a640a1ce4568af20bc9d321bc9a70be"} Nov 04 07:20:02.510168 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:02.510115 5030 generic.go:356] "Generic (PLEG): container finished" podID="ef49e380-50e5-4bd6-8060-c21e81f84a9f" containerID="d2db6a3b56b4f8c9c1ba5779f65216668fb818cfe9e0094b43b7da5746ccfd9b" exitCode=0 Nov 04 07:20:02.510671 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:02.510204 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" event={"ID":"ef49e380-50e5-4bd6-8060-c21e81f84a9f","Type":"ContainerDied","Data":"d2db6a3b56b4f8c9c1ba5779f65216668fb818cfe9e0094b43b7da5746ccfd9b"} Nov 04 07:20:03.517428 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:03.517392 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" event={"ID":"ef49e380-50e5-4bd6-8060-c21e81f84a9f","Type":"ContainerStarted","Data":"ce97129b79fd054d1ddbb6848fee0c0e599da98ce0505d553e7855cd610d196f"} Nov 04 07:20:03.517816 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:03.517584 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" Nov 04 07:20:03.560403 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:03.560359 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" podStartSLOduration=1.87249664 podStartE2EDuration="5.560345672s" totalImagesPullingTime="3.26397929s" totalInitContainerRuntime="423.869742ms" isStatefulPod=false podCreationTimestamp="2026-11-04 07:19:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:20:03.558065116 +0000 UTC m=+277.540693308" watchObservedRunningTime="2026-11-04 07:20:03.560345672 +0000 UTC m=+277.542973868" Nov 04 07:20:04.933665 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:04.933626 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-srf7j"] Nov 04 07:20:04.937323 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:04.937303 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-srf7j" Nov 04 07:20:04.942474 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:04.942443 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Nov 04 07:20:04.942474 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:04.942454 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Nov 04 07:20:04.942672 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:04.942572 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-njx2v\"" Nov 04 07:20:04.952259 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:04.952233 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-srf7j"] Nov 04 07:20:05.007276 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:05.007247 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da9f9e75-62dc-4e70-b78e-567534d15110-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-srf7j\" (UID: \"da9f9e75-62dc-4e70-b78e-567534d15110\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-srf7j" Nov 04 07:20:05.007379 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:05.007306 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvz92\" (UniqueName: \"kubernetes.io/projected/da9f9e75-62dc-4e70-b78e-567534d15110-kube-api-access-mvz92\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-srf7j\" (UID: \"da9f9e75-62dc-4e70-b78e-567534d15110\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-srf7j" Nov 04 07:20:05.108036 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:05.108010 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvz92\" (UniqueName: \"kubernetes.io/projected/da9f9e75-62dc-4e70-b78e-567534d15110-kube-api-access-mvz92\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-srf7j\" (UID: \"da9f9e75-62dc-4e70-b78e-567534d15110\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-srf7j" Nov 04 07:20:05.108144 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:05.108104 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da9f9e75-62dc-4e70-b78e-567534d15110-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-srf7j\" (UID: \"da9f9e75-62dc-4e70-b78e-567534d15110\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-srf7j" Nov 04 07:20:05.108527 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:05.108504 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da9f9e75-62dc-4e70-b78e-567534d15110-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-srf7j\" (UID: \"da9f9e75-62dc-4e70-b78e-567534d15110\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-srf7j" Nov 04 07:20:05.124025 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:05.123993 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvz92\" (UniqueName: \"kubernetes.io/projected/da9f9e75-62dc-4e70-b78e-567534d15110-kube-api-access-mvz92\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-srf7j\" (UID: \"da9f9e75-62dc-4e70-b78e-567534d15110\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-srf7j" Nov 04 07:20:05.249427 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:05.249367 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-srf7j" Nov 04 07:20:05.531805 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:05.531770 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-srf7j"] Nov 04 07:20:05.534909 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:20:05.534873 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda9f9e75_62dc_4e70_b78e_567534d15110.slice/crio-64367e21f5ffa18ac541a637b5bdf5ae4daa76e6b6b4a9f4fab619a93fb8b696 WatchSource:0}: Error finding container 64367e21f5ffa18ac541a637b5bdf5ae4daa76e6b6b4a9f4fab619a93fb8b696: Status 404 returned error can't find the container with id 64367e21f5ffa18ac541a637b5bdf5ae4daa76e6b6b4a9f4fab619a93fb8b696 Nov 04 07:20:06.534680 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:06.534642 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-srf7j" event={"ID":"da9f9e75-62dc-4e70-b78e-567534d15110","Type":"ContainerStarted","Data":"64367e21f5ffa18ac541a637b5bdf5ae4daa76e6b6b4a9f4fab619a93fb8b696"} Nov 04 07:20:08.545711 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:08.545673 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-srf7j" event={"ID":"da9f9e75-62dc-4e70-b78e-567534d15110","Type":"ContainerStarted","Data":"0304c306504090b82774fa24dd6599c85324f074d45b2f5be7340653089509cc"} Nov 04 07:20:08.571154 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:08.571083 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-srf7j" podStartSLOduration=1.77356514 podStartE2EDuration="4.571070265s" totalImagesPullingTime="2.797505125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:20:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:20:08.568646426 +0000 UTC m=+282.551274620" watchObservedRunningTime="2026-11-04 07:20:08.571070265 +0000 UTC m=+282.553698457" Nov 04 07:20:10.522893 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:10.522861 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-fmj2k"] Nov 04 07:20:10.526388 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:10.526371 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fmj2k" Nov 04 07:20:10.533479 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:10.533453 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Nov 04 07:20:10.534335 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:10.534320 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Nov 04 07:20:10.534429 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:10.534414 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-sfb7k\"" Nov 04 07:20:10.537685 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:10.537661 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-fmj2k"] Nov 04 07:20:10.654168 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:10.654119 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwqwn\" (UniqueName: \"kubernetes.io/projected/4a95000c-9422-41b9-83e9-659fc26dfaa6-kube-api-access-pwqwn\") pod \"authorino-operator-7b7bb4bc77-fmj2k\" (UID: \"4a95000c-9422-41b9-83e9-659fc26dfaa6\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-fmj2k" Nov 04 07:20:10.755299 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:10.755269 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwqwn\" (UniqueName: \"kubernetes.io/projected/4a95000c-9422-41b9-83e9-659fc26dfaa6-kube-api-access-pwqwn\") pod \"authorino-operator-7b7bb4bc77-fmj2k\" (UID: \"4a95000c-9422-41b9-83e9-659fc26dfaa6\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-fmj2k" Nov 04 07:20:10.777558 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:10.777506 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwqwn\" (UniqueName: \"kubernetes.io/projected/4a95000c-9422-41b9-83e9-659fc26dfaa6-kube-api-access-pwqwn\") pod \"authorino-operator-7b7bb4bc77-fmj2k\" (UID: \"4a95000c-9422-41b9-83e9-659fc26dfaa6\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-fmj2k" Nov 04 07:20:10.839412 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:10.839382 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fmj2k" Nov 04 07:20:11.113379 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:11.113324 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-fmj2k"] Nov 04 07:20:11.115585 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:20:11.115554 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a95000c_9422_41b9_83e9_659fc26dfaa6.slice/crio-79d8dc84aaf85afbfe8bf3d9b6434469ac5ffe32d5fccbcee93b79ae04eb1935 WatchSource:0}: Error finding container 79d8dc84aaf85afbfe8bf3d9b6434469ac5ffe32d5fccbcee93b79ae04eb1935: Status 404 returned error can't find the container with id 79d8dc84aaf85afbfe8bf3d9b6434469ac5ffe32d5fccbcee93b79ae04eb1935 Nov 04 07:20:11.558830 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:11.558795 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fmj2k" event={"ID":"4a95000c-9422-41b9-83e9-659fc26dfaa6","Type":"ContainerStarted","Data":"79d8dc84aaf85afbfe8bf3d9b6434469ac5ffe32d5fccbcee93b79ae04eb1935"} Nov 04 07:20:14.137621 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:14.137588 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-jtwwh"] Nov 04 07:20:14.141170 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:14.141146 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-jtwwh" Nov 04 07:20:14.149433 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:14.149416 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-hqrvn\"" Nov 04 07:20:14.156717 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:14.156698 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Nov 04 07:20:14.156914 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:14.156897 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-jtwwh"] Nov 04 07:20:14.185251 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:14.185229 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm9s5\" (UniqueName: \"kubernetes.io/projected/31939c31-8295-4fba-8811-96765f243312-kube-api-access-jm9s5\") pod \"dns-operator-controller-manager-8557cbdb84-jtwwh\" (UID: \"31939c31-8295-4fba-8811-96765f243312\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-jtwwh" Nov 04 07:20:14.285826 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:14.285767 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm9s5\" (UniqueName: \"kubernetes.io/projected/31939c31-8295-4fba-8811-96765f243312-kube-api-access-jm9s5\") pod \"dns-operator-controller-manager-8557cbdb84-jtwwh\" (UID: \"31939c31-8295-4fba-8811-96765f243312\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-jtwwh" Nov 04 07:20:14.300650 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:14.300625 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm9s5\" (UniqueName: \"kubernetes.io/projected/31939c31-8295-4fba-8811-96765f243312-kube-api-access-jm9s5\") pod \"dns-operator-controller-manager-8557cbdb84-jtwwh\" (UID: \"31939c31-8295-4fba-8811-96765f243312\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-jtwwh" Nov 04 07:20:14.455076 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:14.455049 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-jtwwh" Nov 04 07:20:14.524091 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:14.524064 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8f94f88d4-klvcl" Nov 04 07:20:14.576964 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:14.576903 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fmj2k" event={"ID":"4a95000c-9422-41b9-83e9-659fc26dfaa6","Type":"ContainerStarted","Data":"5c5c3b3c3b6e5da89d57358003a54d454be34361951349e59ce1fd18f7d14539"} Nov 04 07:20:14.576964 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:14.576954 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fmj2k" Nov 04 07:20:14.619285 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:14.619230 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fmj2k" podStartSLOduration=1.79793389 podStartE2EDuration="4.619217685s" totalImagesPullingTime="2.821283795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:20:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:20:14.618301264 +0000 UTC m=+288.600929466" watchObservedRunningTime="2026-11-04 07:20:14.619217685 +0000 UTC m=+288.601845877" Nov 04 07:20:14.733488 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:14.733460 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-jtwwh"] Nov 04 07:20:14.736471 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:20:14.736442 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31939c31_8295_4fba_8811_96765f243312.slice/crio-79e89aba8c28ad070226b1d72c8b2a6262a13ff73524548a87f26ca2aebb50c8 WatchSource:0}: Error finding container 79e89aba8c28ad070226b1d72c8b2a6262a13ff73524548a87f26ca2aebb50c8: Status 404 returned error can't find the container with id 79e89aba8c28ad070226b1d72c8b2a6262a13ff73524548a87f26ca2aebb50c8 Nov 04 07:20:15.583415 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:15.583386 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-jtwwh" event={"ID":"31939c31-8295-4fba-8811-96765f243312","Type":"ContainerStarted","Data":"79e89aba8c28ad070226b1d72c8b2a6262a13ff73524548a87f26ca2aebb50c8"} Nov 04 07:20:17.595510 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:17.595474 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-jtwwh" event={"ID":"31939c31-8295-4fba-8811-96765f243312","Type":"ContainerStarted","Data":"a0a980b4df2200f97b3c541ad70b06ffee5317ae8522b253a032c4e9a1122636"} Nov 04 07:20:17.595942 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:17.595570 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-jtwwh" Nov 04 07:20:17.617036 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:17.616993 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-jtwwh" podStartSLOduration=1.23038278 podStartE2EDuration="3.616980659s" totalImagesPullingTime="2.386597879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:20:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:20:17.615870664 +0000 UTC m=+291.598498871" watchObservedRunningTime="2026-11-04 07:20:17.616980659 +0000 UTC m=+291.599608851" Nov 04 07:20:18.910186 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:18.910150 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-4c2q5"] Nov 04 07:20:18.913740 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:18.913722 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-4c2q5" Nov 04 07:20:18.933312 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:18.933285 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-4c2q5"] Nov 04 07:20:18.969901 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:18.969877 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-h9b92\"" Nov 04 07:20:19.024431 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:19.024399 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6svk\" (UniqueName: \"kubernetes.io/projected/92015ad5-dc71-4822-beac-d8a06dc412dc-kube-api-access-p6svk\") pod \"limitador-operator-controller-manager-5778bb4449-4c2q5\" (UID: \"92015ad5-dc71-4822-beac-d8a06dc412dc\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-4c2q5" Nov 04 07:20:19.125266 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:19.125221 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6svk\" (UniqueName: \"kubernetes.io/projected/92015ad5-dc71-4822-beac-d8a06dc412dc-kube-api-access-p6svk\") pod \"limitador-operator-controller-manager-5778bb4449-4c2q5\" (UID: \"92015ad5-dc71-4822-beac-d8a06dc412dc\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-4c2q5" Nov 04 07:20:19.162682 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:19.162615 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6svk\" (UniqueName: \"kubernetes.io/projected/92015ad5-dc71-4822-beac-d8a06dc412dc-kube-api-access-p6svk\") pod \"limitador-operator-controller-manager-5778bb4449-4c2q5\" (UID: \"92015ad5-dc71-4822-beac-d8a06dc412dc\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-4c2q5" Nov 04 07:20:19.226160 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:19.226122 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-4c2q5" Nov 04 07:20:19.536378 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:19.536325 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-4c2q5"] Nov 04 07:20:19.539087 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:20:19.539042 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92015ad5_dc71_4822_beac_d8a06dc412dc.slice/crio-ba090907e3541609712fe9f2fb1ac208aa269b27a6795490593480a65e0c863a WatchSource:0}: Error finding container ba090907e3541609712fe9f2fb1ac208aa269b27a6795490593480a65e0c863a: Status 404 returned error can't find the container with id ba090907e3541609712fe9f2fb1ac208aa269b27a6795490593480a65e0c863a Nov 04 07:20:19.605107 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:19.605077 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-4c2q5" event={"ID":"92015ad5-dc71-4822-beac-d8a06dc412dc","Type":"ContainerStarted","Data":"ba090907e3541609712fe9f2fb1ac208aa269b27a6795490593480a65e0c863a"} Nov 04 07:20:21.615802 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:21.615773 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-4c2q5" event={"ID":"92015ad5-dc71-4822-beac-d8a06dc412dc","Type":"ContainerStarted","Data":"917a53dce77b2d177a247b252ef3ee4b2be288d9adda0aaba75e468ac1d35c5a"} Nov 04 07:20:21.616126 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:21.615837 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-4c2q5" Nov 04 07:20:22.140697 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:20:22.140662 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:20:25.199689 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:25.199636 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-4c2q5" podStartSLOduration=5.251920746 podStartE2EDuration="7.19961732s" totalImagesPullingTime="1.947696574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:20:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:20:21.659602159 +0000 UTC m=+295.642230351" watchObservedRunningTime="2026-11-04 07:20:25.19961732 +0000 UTC m=+299.182245516" Nov 04 07:20:25.200064 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:25.199840 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rntjw"] Nov 04 07:20:25.203445 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:25.203429 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rntjw" Nov 04 07:20:25.219618 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:25.219597 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rntjw"] Nov 04 07:20:25.226772 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:25.226752 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-h572m\"" Nov 04 07:20:25.276748 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:25.276722 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-rntjw\" (UID: \"ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rntjw" Nov 04 07:20:25.276862 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:25.276766 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnlrq\" (UniqueName: \"kubernetes.io/projected/ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d-kube-api-access-cnlrq\") pod \"kuadrant-operator-controller-manager-678d87766f-rntjw\" (UID: \"ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rntjw" Nov 04 07:20:25.377551 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:25.377524 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-rntjw\" (UID: \"ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rntjw" Nov 04 07:20:25.377670 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:25.377567 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnlrq\" (UniqueName: \"kubernetes.io/projected/ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d-kube-api-access-cnlrq\") pod \"kuadrant-operator-controller-manager-678d87766f-rntjw\" (UID: \"ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rntjw" Nov 04 07:20:25.377885 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:25.377862 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-rntjw\" (UID: \"ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rntjw" Nov 04 07:20:25.397045 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:25.397025 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnlrq\" (UniqueName: \"kubernetes.io/projected/ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d-kube-api-access-cnlrq\") pod \"kuadrant-operator-controller-manager-678d87766f-rntjw\" (UID: \"ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rntjw" Nov 04 07:20:25.516333 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:25.516279 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rntjw" Nov 04 07:20:25.585615 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:25.585591 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fmj2k" Nov 04 07:20:25.794325 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:25.794298 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rntjw"] Nov 04 07:20:25.799691 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:20:25.797695 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea4a09e5_93e1_4ea6_89e6_2c6bb5bc935d.slice/crio-f03bd57bd7fc4ae30964adc555a936b1e38fee45876576e5bc376461370c5359 WatchSource:0}: Error finding container f03bd57bd7fc4ae30964adc555a936b1e38fee45876576e5bc376461370c5359: Status 404 returned error can't find the container with id f03bd57bd7fc4ae30964adc555a936b1e38fee45876576e5bc376461370c5359 Nov 04 07:20:26.162113 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:26.162045 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-9k9rx_ecfd331a-08c4-43ac-a58c-9f43935d06ed/console-operator/2.log" Nov 04 07:20:26.165085 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:26.165061 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-9k9rx_ecfd331a-08c4-43ac-a58c-9f43935d06ed/console-operator/2.log" Nov 04 07:20:26.167825 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:26.167803 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4d9w_9084f3dd-8da4-431c-8040-1e268c3fa964/ovn-acl-logging/0.log" Nov 04 07:20:26.170738 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:26.170718 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4d9w_9084f3dd-8da4-431c-8040-1e268c3fa964/ovn-acl-logging/0.log" Nov 04 07:20:26.638653 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:26.638618 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rntjw" event={"ID":"ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d","Type":"ContainerStarted","Data":"f03bd57bd7fc4ae30964adc555a936b1e38fee45876576e5bc376461370c5359"} Nov 04 07:20:28.601554 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:28.601519 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-jtwwh" Nov 04 07:20:30.662543 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:30.662504 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rntjw" event={"ID":"ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d","Type":"ContainerStarted","Data":"27fb759ee67beab701a13d93e0d187237a94c8c0da9c12d882065392f8535527"} Nov 04 07:20:30.663066 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:30.662711 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rntjw" Nov 04 07:20:30.726058 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:30.725982 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rntjw" podStartSLOduration=1.418860743 podStartE2EDuration="5.725965242s" totalImagesPullingTime="4.307104499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:20:30.725496626 +0000 UTC m=+304.708124820" watchObservedRunningTime="2026-11-04 07:20:30.725965242 +0000 UTC m=+304.708593437" Nov 04 07:20:31.334324 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.334275 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq"] Nov 04 07:20:31.356318 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.356287 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.361180 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.361154 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq"] Nov 04 07:20:31.368795 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.368771 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-nmzrg\"" Nov 04 07:20:31.427877 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.427837 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.428058 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.427885 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.428058 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.427975 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.428058 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.428015 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.428258 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.428082 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.428258 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.428119 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gfhp\" (UniqueName: \"kubernetes.io/projected/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-kube-api-access-4gfhp\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.428258 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.428161 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.428258 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.428223 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.428471 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.428314 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.529099 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.529053 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.529297 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.529127 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.529297 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.529176 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.529418 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.529356 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.529418 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.529391 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.529530 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.529438 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gfhp\" (UniqueName: \"kubernetes.io/projected/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-kube-api-access-4gfhp\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.529530 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.529484 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.529530 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.529509 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.529680 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.529554 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.529680 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.529562 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.529804 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.529747 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.529932 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.529908 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.530125 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.530096 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.530521 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.530496 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.531760 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.531740 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.531842 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.531816 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.554557 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.554534 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.554748 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.554729 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gfhp\" (UniqueName: \"kubernetes.io/projected/ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b-kube-api-access-4gfhp\") pod \"data-science-gateway-data-science-gateway-class-576b8db9c752pzq\" (UID: \"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.674366 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.674338 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:31.963519 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.963481 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq"] Nov 04 07:20:31.965006 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:20:31.964974 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae3d04f0_aadb_4a3d_9b50_dd5d42c5b94b.slice/crio-03ec9c047034d1595436f5bc59493e915b0e30065cf9e3c319cfa793709c4fd0 WatchSource:0}: Error finding container 03ec9c047034d1595436f5bc59493e915b0e30065cf9e3c319cfa793709c4fd0: Status 404 returned error can't find the container with id 03ec9c047034d1595436f5bc59493e915b0e30065cf9e3c319cfa793709c4fd0 Nov 04 07:20:31.967585 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.967554 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:20:31.967693 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.967633 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:20:31.967693 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:31.967676 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:20:32.622239 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:32.622208 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-4c2q5" Nov 04 07:20:32.675046 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:32.675004 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" event={"ID":"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b","Type":"ContainerStarted","Data":"6d0a3e0cdc61cce38461931a64471b9abf2fbebb84379b9800f222205e1a0736"} Nov 04 07:20:32.675447 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:32.675071 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" event={"ID":"ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b","Type":"ContainerStarted","Data":"03ec9c047034d1595436f5bc59493e915b0e30065cf9e3c319cfa793709c4fd0"} Nov 04 07:20:32.676184 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:32.676157 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:32.726016 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:32.725957 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" podStartSLOduration=1.725938963 podStartE2EDuration="1.725938963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:20:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:20:32.723119376 +0000 UTC m=+306.705747603" watchObservedRunningTime="2026-11-04 07:20:32.725938963 +0000 UTC m=+306.708567157" Nov 04 07:20:33.680599 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:33.680568 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:33.681062 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:33.680982 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:33.681633 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:33.681601 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-576b8db9c752pzq" Nov 04 07:20:41.670915 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:20:41.670843 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rntjw" Nov 04 07:20:52.139626 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:20:52.139581 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:21:22.139040 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:21:22.138997 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:21:27.044630 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.044592 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-xccjr"] Nov 04 07:21:27.048376 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.048352 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xccjr" Nov 04 07:21:27.059054 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.059029 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Nov 04 07:21:27.059054 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.059051 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Nov 04 07:21:27.063574 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.063552 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-xccjr"] Nov 04 07:21:27.072286 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.072265 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-cnldr\"" Nov 04 07:21:27.072286 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.072265 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Nov 04 07:21:27.087485 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.087458 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-769875db56-mcg7w"] Nov 04 07:21:27.090669 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.090649 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-mcg7w" Nov 04 07:21:27.103981 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.103961 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-mcg7w"] Nov 04 07:21:27.118518 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.118421 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-nw9wj\"" Nov 04 07:21:27.118518 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.118485 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\"" Nov 04 07:21:27.118930 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.118908 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Nov 04 07:21:27.190010 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.189983 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41781aaa-b723-4863-928f-6a0925384d73-cert\") pod \"odh-model-controller-769875db56-mcg7w\" (UID: \"41781aaa-b723-4863-928f-6a0925384d73\") " pod="opendatahub/odh-model-controller-769875db56-mcg7w" Nov 04 07:21:27.190187 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.190017 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds55p\" (UniqueName: \"kubernetes.io/projected/2328054b-9450-4bb5-98ca-d9a3e49dcd95-kube-api-access-ds55p\") pod \"llmisvc-controller-manager-869d5dcc5d-xccjr\" (UID: \"2328054b-9450-4bb5-98ca-d9a3e49dcd95\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xccjr" Nov 04 07:21:27.190187 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.190039 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvfvf\" (UniqueName: \"kubernetes.io/projected/41781aaa-b723-4863-928f-6a0925384d73-kube-api-access-rvfvf\") pod \"odh-model-controller-769875db56-mcg7w\" (UID: \"41781aaa-b723-4863-928f-6a0925384d73\") " pod="opendatahub/odh-model-controller-769875db56-mcg7w" Nov 04 07:21:27.190265 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.190206 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41781aaa-b723-4863-928f-6a0925384d73-metrics-certs\") pod \"odh-model-controller-769875db56-mcg7w\" (UID: \"41781aaa-b723-4863-928f-6a0925384d73\") " pod="opendatahub/odh-model-controller-769875db56-mcg7w" Nov 04 07:21:27.190265 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.190231 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2328054b-9450-4bb5-98ca-d9a3e49dcd95-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-xccjr\" (UID: \"2328054b-9450-4bb5-98ca-d9a3e49dcd95\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xccjr" Nov 04 07:21:27.291270 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.291246 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41781aaa-b723-4863-928f-6a0925384d73-cert\") pod \"odh-model-controller-769875db56-mcg7w\" (UID: \"41781aaa-b723-4863-928f-6a0925384d73\") " pod="opendatahub/odh-model-controller-769875db56-mcg7w" Nov 04 07:21:27.291412 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.291276 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds55p\" (UniqueName: \"kubernetes.io/projected/2328054b-9450-4bb5-98ca-d9a3e49dcd95-kube-api-access-ds55p\") pod \"llmisvc-controller-manager-869d5dcc5d-xccjr\" (UID: \"2328054b-9450-4bb5-98ca-d9a3e49dcd95\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xccjr" Nov 04 07:21:27.291412 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.291305 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvfvf\" (UniqueName: \"kubernetes.io/projected/41781aaa-b723-4863-928f-6a0925384d73-kube-api-access-rvfvf\") pod \"odh-model-controller-769875db56-mcg7w\" (UID: \"41781aaa-b723-4863-928f-6a0925384d73\") " pod="opendatahub/odh-model-controller-769875db56-mcg7w" Nov 04 07:21:27.291412 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.291357 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41781aaa-b723-4863-928f-6a0925384d73-metrics-certs\") pod \"odh-model-controller-769875db56-mcg7w\" (UID: \"41781aaa-b723-4863-928f-6a0925384d73\") " pod="opendatahub/odh-model-controller-769875db56-mcg7w" Nov 04 07:21:27.291412 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.291382 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2328054b-9450-4bb5-98ca-d9a3e49dcd95-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-xccjr\" (UID: \"2328054b-9450-4bb5-98ca-d9a3e49dcd95\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xccjr" Nov 04 07:21:27.294245 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.294216 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41781aaa-b723-4863-928f-6a0925384d73-cert\") pod \"odh-model-controller-769875db56-mcg7w\" (UID: \"41781aaa-b723-4863-928f-6a0925384d73\") " pod="opendatahub/odh-model-controller-769875db56-mcg7w" Nov 04 07:21:27.294245 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.294227 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2328054b-9450-4bb5-98ca-d9a3e49dcd95-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-xccjr\" (UID: \"2328054b-9450-4bb5-98ca-d9a3e49dcd95\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xccjr" Nov 04 07:21:27.294376 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.294365 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41781aaa-b723-4863-928f-6a0925384d73-metrics-certs\") pod \"odh-model-controller-769875db56-mcg7w\" (UID: \"41781aaa-b723-4863-928f-6a0925384d73\") " pod="opendatahub/odh-model-controller-769875db56-mcg7w" Nov 04 07:21:27.304112 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.304053 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds55p\" (UniqueName: \"kubernetes.io/projected/2328054b-9450-4bb5-98ca-d9a3e49dcd95-kube-api-access-ds55p\") pod \"llmisvc-controller-manager-869d5dcc5d-xccjr\" (UID: \"2328054b-9450-4bb5-98ca-d9a3e49dcd95\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xccjr" Nov 04 07:21:27.304112 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.304053 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvfvf\" (UniqueName: \"kubernetes.io/projected/41781aaa-b723-4863-928f-6a0925384d73-kube-api-access-rvfvf\") pod \"odh-model-controller-769875db56-mcg7w\" (UID: \"41781aaa-b723-4863-928f-6a0925384d73\") " pod="opendatahub/odh-model-controller-769875db56-mcg7w" Nov 04 07:21:27.361618 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.361592 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xccjr" Nov 04 07:21:27.403896 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.403870 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-mcg7w" Nov 04 07:21:27.655361 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.655107 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-xccjr"] Nov 04 07:21:27.657728 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:21:27.657697 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2328054b_9450_4bb5_98ca_d9a3e49dcd95.slice/crio-791ba22d95d6bc23f161824a6a192177edfe681d423531fe90323a6d64f0b6d7 WatchSource:0}: Error finding container 791ba22d95d6bc23f161824a6a192177edfe681d423531fe90323a6d64f0b6d7: Status 404 returned error can't find the container with id 791ba22d95d6bc23f161824a6a192177edfe681d423531fe90323a6d64f0b6d7 Nov 04 07:21:27.659391 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.659373 5030 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 07:21:27.692900 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.692835 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-mcg7w"] Nov 04 07:21:27.694979 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:21:27.694954 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41781aaa_b723_4863_928f_6a0925384d73.slice/crio-c25f23dcd6220b258c7ad32edf34750127434ab0db230dcb0dc861c26508d3ce WatchSource:0}: Error finding container c25f23dcd6220b258c7ad32edf34750127434ab0db230dcb0dc861c26508d3ce: Status 404 returned error can't find the container with id c25f23dcd6220b258c7ad32edf34750127434ab0db230dcb0dc861c26508d3ce Nov 04 07:21:27.949183 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.949128 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-mcg7w" event={"ID":"41781aaa-b723-4863-928f-6a0925384d73","Type":"ContainerStarted","Data":"c25f23dcd6220b258c7ad32edf34750127434ab0db230dcb0dc861c26508d3ce"} Nov 04 07:21:27.950386 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:27.950360 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xccjr" event={"ID":"2328054b-9450-4bb5-98ca-d9a3e49dcd95","Type":"ContainerStarted","Data":"791ba22d95d6bc23f161824a6a192177edfe681d423531fe90323a6d64f0b6d7"} Nov 04 07:21:31.975468 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:31.975425 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-mcg7w" event={"ID":"41781aaa-b723-4863-928f-6a0925384d73","Type":"ContainerStarted","Data":"86acab49f7f05dcdea0f7a214ceadae22328f9fcf181f197e8295593e38209b9"} Nov 04 07:21:31.976076 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:31.975670 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-769875db56-mcg7w" Nov 04 07:21:31.977021 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:31.977001 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xccjr" event={"ID":"2328054b-9450-4bb5-98ca-d9a3e49dcd95","Type":"ContainerStarted","Data":"0127e45d69cfafbebf9ed3bb864bd6e2fe6d205941118619d6918d25d62a2499"} Nov 04 07:21:31.977189 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:31.977174 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xccjr" Nov 04 07:21:31.995213 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:31.995175 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-769875db56-mcg7w" podStartSLOduration=1.672621804 podStartE2EDuration="4.995163652s" totalImagesPullingTime="3.322541848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:21:31.994629891 +0000 UTC m=+365.977258083" watchObservedRunningTime="2026-11-04 07:21:31.995163652 +0000 UTC m=+365.977791843" Nov 04 07:21:32.014792 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:32.014756 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xccjr" podStartSLOduration=1.653094899 podStartE2EDuration="5.014747373s" totalImagesPullingTime="3.361652474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:21:32.013232738 +0000 UTC m=+365.995860942" watchObservedRunningTime="2026-11-04 07:21:32.014747373 +0000 UTC m=+365.997375565" Nov 04 07:21:42.983777 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:21:42.983741 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-769875db56-mcg7w" Nov 04 07:21:52.139514 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:21:52.139479 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:22:02.983847 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:22:02.983812 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xccjr" Nov 04 07:22:22.140775 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:22:22.140735 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:22:52.141517 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:22:52.141480 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:23:22.143784 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:23:22.143745 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:23:52.139688 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:23:52.139605 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:24:22.140912 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:24:22.140871 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:24:52.139996 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:24:52.139949 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:25:22.141041 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:25:22.140956 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:25:26.194058 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:25:26.194022 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-9k9rx_ecfd331a-08c4-43ac-a58c-9f43935d06ed/console-operator/2.log" Nov 04 07:25:26.194535 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:25:26.194517 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-9k9rx_ecfd331a-08c4-43ac-a58c-9f43935d06ed/console-operator/2.log" Nov 04 07:25:26.205786 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:25:26.205756 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4d9w_9084f3dd-8da4-431c-8040-1e268c3fa964/ovn-acl-logging/0.log" Nov 04 07:25:26.205926 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:25:26.205887 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4d9w_9084f3dd-8da4-431c-8040-1e268c3fa964/ovn-acl-logging/0.log" Nov 04 07:25:52.141055 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:25:52.141018 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:26:22.139796 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:26:22.139758 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:26:52.140526 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:26:52.140442 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:27:22.139318 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:27:22.139281 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:27:52.139817 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:27:52.139760 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:28:22.140085 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:28:22.140000 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:28:52.147079 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:28:52.147041 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:29:22.141838 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:29:22.141799 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:29:52.143491 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:29:52.143364 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:30:22.141219 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:30:22.141181 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:30:26.245518 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:26.245490 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-9k9rx_ecfd331a-08c4-43ac-a58c-9f43935d06ed/console-operator/2.log" Nov 04 07:30:26.246068 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:26.246045 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-9k9rx_ecfd331a-08c4-43ac-a58c-9f43935d06ed/console-operator/2.log" Nov 04 07:30:26.250923 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:26.250903 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4d9w_9084f3dd-8da4-431c-8040-1e268c3fa964/ovn-acl-logging/0.log" Nov 04 07:30:26.251589 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:26.251567 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4d9w_9084f3dd-8da4-431c-8040-1e268c3fa964/ovn-acl-logging/0.log" Nov 04 07:30:51.171083 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.171050 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-rntjw_ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d/manager/0.log" Nov 04 07:30:51.355051 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.355020 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rntjw"] Nov 04 07:30:51.355244 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.355220 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rntjw" podUID="ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d" containerName="manager" containerID="cri-o://27fb759ee67beab701a13d93e0d187237a94c8c0da9c12d882065392f8535527" gracePeriod=10 Nov 04 07:30:51.482013 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.481988 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sqpgg"] Nov 04 07:30:51.485478 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.485454 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sqpgg" Nov 04 07:30:51.507639 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.507611 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sqpgg"] Nov 04 07:30:51.529521 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.529064 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4139aec4-ab58-4f94-b036-3475c0c8d459-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-sqpgg\" (UID: \"4139aec4-ab58-4f94-b036-3475c0c8d459\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sqpgg" Nov 04 07:30:51.529521 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.529100 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcqbw\" (UniqueName: \"kubernetes.io/projected/4139aec4-ab58-4f94-b036-3475c0c8d459-kube-api-access-dcqbw\") pod \"kuadrant-operator-controller-manager-678d87766f-sqpgg\" (UID: \"4139aec4-ab58-4f94-b036-3475c0c8d459\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sqpgg" Nov 04 07:30:51.613164 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.613119 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rntjw" Nov 04 07:30:51.630526 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.630502 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4139aec4-ab58-4f94-b036-3475c0c8d459-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-sqpgg\" (UID: \"4139aec4-ab58-4f94-b036-3475c0c8d459\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sqpgg" Nov 04 07:30:51.630621 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.630538 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcqbw\" (UniqueName: \"kubernetes.io/projected/4139aec4-ab58-4f94-b036-3475c0c8d459-kube-api-access-dcqbw\") pod \"kuadrant-operator-controller-manager-678d87766f-sqpgg\" (UID: \"4139aec4-ab58-4f94-b036-3475c0c8d459\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sqpgg" Nov 04 07:30:51.630874 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.630854 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4139aec4-ab58-4f94-b036-3475c0c8d459-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-sqpgg\" (UID: \"4139aec4-ab58-4f94-b036-3475c0c8d459\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sqpgg" Nov 04 07:30:51.646145 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.646104 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcqbw\" (UniqueName: \"kubernetes.io/projected/4139aec4-ab58-4f94-b036-3475c0c8d459-kube-api-access-dcqbw\") pod \"kuadrant-operator-controller-manager-678d87766f-sqpgg\" (UID: \"4139aec4-ab58-4f94-b036-3475c0c8d459\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sqpgg" Nov 04 07:30:51.683328 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.683298 5030 generic.go:356] "Generic (PLEG): container finished" podID="ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d" containerID="27fb759ee67beab701a13d93e0d187237a94c8c0da9c12d882065392f8535527" exitCode=0 Nov 04 07:30:51.683450 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.683341 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rntjw" Nov 04 07:30:51.683450 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.683357 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rntjw" event={"ID":"ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d","Type":"ContainerDied","Data":"27fb759ee67beab701a13d93e0d187237a94c8c0da9c12d882065392f8535527"} Nov 04 07:30:51.683450 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.683412 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rntjw" event={"ID":"ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d","Type":"ContainerDied","Data":"f03bd57bd7fc4ae30964adc555a936b1e38fee45876576e5bc376461370c5359"} Nov 04 07:30:51.683450 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.683443 5030 scope.go:122] "RemoveContainer" containerID="27fb759ee67beab701a13d93e0d187237a94c8c0da9c12d882065392f8535527" Nov 04 07:30:51.692522 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.692497 5030 scope.go:122] "RemoveContainer" containerID="27fb759ee67beab701a13d93e0d187237a94c8c0da9c12d882065392f8535527" Nov 04 07:30:51.692819 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:30:51.692800 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27fb759ee67beab701a13d93e0d187237a94c8c0da9c12d882065392f8535527\": container with ID starting with 27fb759ee67beab701a13d93e0d187237a94c8c0da9c12d882065392f8535527 not found: ID does not exist" containerID="27fb759ee67beab701a13d93e0d187237a94c8c0da9c12d882065392f8535527" Nov 04 07:30:51.692890 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.692830 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27fb759ee67beab701a13d93e0d187237a94c8c0da9c12d882065392f8535527"} err="failed to get container status \"27fb759ee67beab701a13d93e0d187237a94c8c0da9c12d882065392f8535527\": rpc error: code = NotFound desc = could not find container \"27fb759ee67beab701a13d93e0d187237a94c8c0da9c12d882065392f8535527\": container with ID starting with 27fb759ee67beab701a13d93e0d187237a94c8c0da9c12d882065392f8535527 not found: ID does not exist" Nov 04 07:30:51.731257 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.731202 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d-extensions-socket-volume\") pod \"ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d\" (UID: \"ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d\") " Nov 04 07:30:51.731338 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.731305 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d-kube-api-access-cnlrq\" (UniqueName: \"kubernetes.io/projected/ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d-kube-api-access-cnlrq\") pod \"ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d\" (UID: \"ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d\") " Nov 04 07:30:51.731537 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.731518 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d-extensions-socket-volume" pod "ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d" (UID: "ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:30:51.733254 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.733233 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d-kube-api-access-cnlrq" pod "ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d" (UID: "ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d"). InnerVolumeSpecName "kube-api-access-cnlrq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:30:51.798244 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.798222 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sqpgg" Nov 04 07:30:51.832944 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.832914 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnlrq\" (UniqueName: \"kubernetes.io/projected/ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d-kube-api-access-cnlrq\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:30:51.833059 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:51.832947 5030 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d-extensions-socket-volume\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:30:52.009816 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:52.009790 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rntjw"] Nov 04 07:30:52.014828 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:52.014805 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-rntjw"] Nov 04 07:30:52.079337 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:52.079318 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sqpgg"] Nov 04 07:30:52.082634 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:30:52.082610 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4139aec4_ab58_4f94_b036_3475c0c8d459.slice/crio-7edcbb9784578ff60d6e99cfdffe27fa6e0bfb66508e38a91c5d0dda7e7a70d5 WatchSource:0}: Error finding container 7edcbb9784578ff60d6e99cfdffe27fa6e0bfb66508e38a91c5d0dda7e7a70d5: Status 404 returned error can't find the container with id 7edcbb9784578ff60d6e99cfdffe27fa6e0bfb66508e38a91c5d0dda7e7a70d5 Nov 04 07:30:52.144074 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:30:52.144024 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:30:52.145175 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:52.145153 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d" path="/var/lib/kubelet/pods/ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d/volumes" Nov 04 07:30:52.690039 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:52.689984 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sqpgg" event={"ID":"4139aec4-ab58-4f94-b036-3475c0c8d459","Type":"ContainerStarted","Data":"c7ae75e3ae0f9a13f28edd227d37bbaef2b0f0ffdac9bc70f02808cc240fed62"} Nov 04 07:30:52.690529 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:52.690159 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sqpgg" Nov 04 07:30:52.690529 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:52.690199 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sqpgg" event={"ID":"4139aec4-ab58-4f94-b036-3475c0c8d459","Type":"ContainerStarted","Data":"7edcbb9784578ff60d6e99cfdffe27fa6e0bfb66508e38a91c5d0dda7e7a70d5"} Nov 04 07:30:52.713150 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:30:52.713088 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sqpgg" podStartSLOduration=1.713075398 podStartE2EDuration="1.713075398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:30:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:30:52.712199354 +0000 UTC m=+926.694827545" watchObservedRunningTime="2026-11-04 07:30:52.713075398 +0000 UTC m=+926.695703590" Nov 04 07:31:03.698577 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:03.698545 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-sqpgg" Nov 04 07:31:09.250748 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.250674 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-xwnp7"] Nov 04 07:31:09.251238 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.251219 5030 cpu_manager.go:414] "containerMap: removing container" podUID="ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d" containerName="manager" Nov 04 07:31:09.251289 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.251241 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d" containerName="manager" Nov 04 07:31:09.251356 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.251343 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="ea4a09e5-93e1-4ea6-89e6-2c6bb5bc935d" containerName="manager" Nov 04 07:31:09.257016 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.256993 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xwnp7" Nov 04 07:31:09.268908 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.267058 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Nov 04 07:31:09.268908 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.268588 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-xwnp7"] Nov 04 07:31:09.271200 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.271177 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Nov 04 07:31:09.271325 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.271299 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-888hp\"" Nov 04 07:31:09.369511 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.369474 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2956fe2-f38a-4d14-8973-00f8ec02a0fb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-xwnp7\" (UID: \"e2956fe2-f38a-4d14-8973-00f8ec02a0fb\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xwnp7" Nov 04 07:31:09.369722 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.369597 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e2956fe2-f38a-4d14-8973-00f8ec02a0fb-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-xwnp7\" (UID: \"e2956fe2-f38a-4d14-8973-00f8ec02a0fb\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xwnp7" Nov 04 07:31:09.369722 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.369635 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbnq2\" (UniqueName: \"kubernetes.io/projected/e2956fe2-f38a-4d14-8973-00f8ec02a0fb-kube-api-access-lbnq2\") pod \"kuadrant-console-plugin-66c4fb575d-xwnp7\" (UID: \"e2956fe2-f38a-4d14-8973-00f8ec02a0fb\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xwnp7" Nov 04 07:31:09.470021 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.469994 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e2956fe2-f38a-4d14-8973-00f8ec02a0fb-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-xwnp7\" (UID: \"e2956fe2-f38a-4d14-8973-00f8ec02a0fb\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xwnp7" Nov 04 07:31:09.470195 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.470032 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbnq2\" (UniqueName: \"kubernetes.io/projected/e2956fe2-f38a-4d14-8973-00f8ec02a0fb-kube-api-access-lbnq2\") pod \"kuadrant-console-plugin-66c4fb575d-xwnp7\" (UID: \"e2956fe2-f38a-4d14-8973-00f8ec02a0fb\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xwnp7" Nov 04 07:31:09.470195 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.470081 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2956fe2-f38a-4d14-8973-00f8ec02a0fb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-xwnp7\" (UID: \"e2956fe2-f38a-4d14-8973-00f8ec02a0fb\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xwnp7" Nov 04 07:31:09.470645 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.470625 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e2956fe2-f38a-4d14-8973-00f8ec02a0fb-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-xwnp7\" (UID: \"e2956fe2-f38a-4d14-8973-00f8ec02a0fb\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xwnp7" Nov 04 07:31:09.472263 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.472245 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2956fe2-f38a-4d14-8973-00f8ec02a0fb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-xwnp7\" (UID: \"e2956fe2-f38a-4d14-8973-00f8ec02a0fb\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xwnp7" Nov 04 07:31:09.482063 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.482017 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbnq2\" (UniqueName: \"kubernetes.io/projected/e2956fe2-f38a-4d14-8973-00f8ec02a0fb-kube-api-access-lbnq2\") pod \"kuadrant-console-plugin-66c4fb575d-xwnp7\" (UID: \"e2956fe2-f38a-4d14-8973-00f8ec02a0fb\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xwnp7" Nov 04 07:31:09.565990 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.565924 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:31:09.569624 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.569588 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-z9lc6" Nov 04 07:31:09.578334 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.578313 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Nov 04 07:31:09.580389 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.580364 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:31:09.587937 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.587915 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xwnp7" Nov 04 07:31:09.617425 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.617394 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:31:09.671522 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.671491 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czqfz\" (UniqueName: \"kubernetes.io/projected/bad7bc32-bbd4-41c7-8fc5-04ca96400ce1-kube-api-access-czqfz\") pod \"limitador-limitador-7c9b87d574-z9lc6\" (UID: \"bad7bc32-bbd4-41c7-8fc5-04ca96400ce1\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-z9lc6" Nov 04 07:31:09.671643 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.671538 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bad7bc32-bbd4-41c7-8fc5-04ca96400ce1-config-file\") pod \"limitador-limitador-7c9b87d574-z9lc6\" (UID: \"bad7bc32-bbd4-41c7-8fc5-04ca96400ce1\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-z9lc6" Nov 04 07:31:09.772478 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.772450 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czqfz\" (UniqueName: \"kubernetes.io/projected/bad7bc32-bbd4-41c7-8fc5-04ca96400ce1-kube-api-access-czqfz\") pod \"limitador-limitador-7c9b87d574-z9lc6\" (UID: \"bad7bc32-bbd4-41c7-8fc5-04ca96400ce1\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-z9lc6" Nov 04 07:31:09.772605 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.772496 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bad7bc32-bbd4-41c7-8fc5-04ca96400ce1-config-file\") pod \"limitador-limitador-7c9b87d574-z9lc6\" (UID: \"bad7bc32-bbd4-41c7-8fc5-04ca96400ce1\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-z9lc6" Nov 04 07:31:09.773154 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.773115 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bad7bc32-bbd4-41c7-8fc5-04ca96400ce1-config-file\") pod \"limitador-limitador-7c9b87d574-z9lc6\" (UID: \"bad7bc32-bbd4-41c7-8fc5-04ca96400ce1\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-z9lc6" Nov 04 07:31:09.784609 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.784579 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czqfz\" (UniqueName: \"kubernetes.io/projected/bad7bc32-bbd4-41c7-8fc5-04ca96400ce1-kube-api-access-czqfz\") pod \"limitador-limitador-7c9b87d574-z9lc6\" (UID: \"bad7bc32-bbd4-41c7-8fc5-04ca96400ce1\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-z9lc6" Nov 04 07:31:09.867086 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.867032 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-xwnp7"] Nov 04 07:31:09.869214 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:31:09.869192 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2956fe2_f38a_4d14_8973_00f8ec02a0fb.slice/crio-6ca10a1822cdbd324c022100041bb1e4da5a211d9f98c2b8d411475663290f61 WatchSource:0}: Error finding container 6ca10a1822cdbd324c022100041bb1e4da5a211d9f98c2b8d411475663290f61: Status 404 returned error can't find the container with id 6ca10a1822cdbd324c022100041bb1e4da5a211d9f98c2b8d411475663290f61 Nov 04 07:31:09.870566 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.870548 5030 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 07:31:09.883546 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:09.883522 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-z9lc6" Nov 04 07:31:10.158688 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:10.158608 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:31:10.162348 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:31:10.162316 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbad7bc32_bbd4_41c7_8fc5_04ca96400ce1.slice/crio-d3976fe9298e7c739511e5938439407ab1e7417146e6bb7259f8fc35f15f973e WatchSource:0}: Error finding container d3976fe9298e7c739511e5938439407ab1e7417146e6bb7259f8fc35f15f973e: Status 404 returned error can't find the container with id d3976fe9298e7c739511e5938439407ab1e7417146e6bb7259f8fc35f15f973e Nov 04 07:31:10.779252 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:10.779205 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-z9lc6" event={"ID":"bad7bc32-bbd4-41c7-8fc5-04ca96400ce1","Type":"ContainerStarted","Data":"d3976fe9298e7c739511e5938439407ab1e7417146e6bb7259f8fc35f15f973e"} Nov 04 07:31:10.780415 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:10.780389 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xwnp7" event={"ID":"e2956fe2-f38a-4d14-8973-00f8ec02a0fb","Type":"ContainerStarted","Data":"6ca10a1822cdbd324c022100041bb1e4da5a211d9f98c2b8d411475663290f61"} Nov 04 07:31:14.803410 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:14.803378 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xwnp7" event={"ID":"e2956fe2-f38a-4d14-8973-00f8ec02a0fb","Type":"ContainerStarted","Data":"5f17243a887efce421567b6d1c48d703ae72403dc58acee2e81880c523354b86"} Nov 04 07:31:14.823732 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:14.823693 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-xwnp7" podStartSLOduration=0.9580973 podStartE2EDuration="5.823679556s" totalImagesPullingTime="4.865582256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:31:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:31:14.822344289 +0000 UTC m=+948.804972482" watchObservedRunningTime="2026-11-04 07:31:14.823679556 +0000 UTC m=+948.806307766" Nov 04 07:31:16.817258 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:16.817220 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-z9lc6" event={"ID":"bad7bc32-bbd4-41c7-8fc5-04ca96400ce1","Type":"ContainerStarted","Data":"4a1bd74b9683efaaaff91b0310a587928aaf9c1ed110916a874c432d5324ff81"} Nov 04 07:31:16.817708 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:16.817304 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-z9lc6" Nov 04 07:31:16.836817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:16.836771 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7c9b87d574-z9lc6" podStartSLOduration=2.115245713 podStartE2EDuration="7.836758823s" totalImagesPullingTime="5.72151311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:31:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:31:16.83632615 +0000 UTC m=+950.818954346" watchObservedRunningTime="2026-11-04 07:31:16.836758823 +0000 UTC m=+950.819387048" Nov 04 07:31:22.139639 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:31:22.139602 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:31:27.825268 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:31:27.825236 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-z9lc6" Nov 04 07:31:52.139977 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:31:52.139941 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:32:22.142676 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:32:22.142629 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:32:29.436384 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:29.436344 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:32:40.537962 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:40.537874 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-69f57ff875-j5qjr"] Nov 04 07:32:40.541931 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:40.541908 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-69f57ff875-j5qjr" Nov 04 07:32:40.545842 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:40.545820 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 04 07:32:40.547010 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:40.546993 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 04 07:32:40.552215 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:40.552192 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-69f57ff875-j5qjr"] Nov 04 07:32:40.583649 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:40.583620 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hv4qq\"" Nov 04 07:32:40.583649 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:40.583636 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Nov 04 07:32:40.583777 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:40.583672 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Nov 04 07:32:40.679389 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:40.679358 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ede4643-54d3-4cce-b3d3-f5f712530980-openshift-service-ca\") pod \"maas-api-69f57ff875-j5qjr\" (UID: \"7ede4643-54d3-4cce-b3d3-f5f712530980\") " pod="odh-ai-gateway-infra/maas-api-69f57ff875-j5qjr" Nov 04 07:32:40.679502 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:40.679392 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ede4643-54d3-4cce-b3d3-f5f712530980-metrics-certs\") pod \"maas-api-69f57ff875-j5qjr\" (UID: \"7ede4643-54d3-4cce-b3d3-f5f712530980\") " pod="odh-ai-gateway-infra/maas-api-69f57ff875-j5qjr" Nov 04 07:32:40.679502 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:40.679428 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ede4643-54d3-4cce-b3d3-f5f712530980-maas-api-tls\") pod \"maas-api-69f57ff875-j5qjr\" (UID: \"7ede4643-54d3-4cce-b3d3-f5f712530980\") " pod="odh-ai-gateway-infra/maas-api-69f57ff875-j5qjr" Nov 04 07:32:40.679615 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:40.679547 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h2j2\" (UniqueName: \"kubernetes.io/projected/7ede4643-54d3-4cce-b3d3-f5f712530980-kube-api-access-8h2j2\") pod \"maas-api-69f57ff875-j5qjr\" (UID: \"7ede4643-54d3-4cce-b3d3-f5f712530980\") " pod="odh-ai-gateway-infra/maas-api-69f57ff875-j5qjr" Nov 04 07:32:40.780268 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:40.780238 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ede4643-54d3-4cce-b3d3-f5f712530980-maas-api-tls\") pod \"maas-api-69f57ff875-j5qjr\" (UID: \"7ede4643-54d3-4cce-b3d3-f5f712530980\") " pod="odh-ai-gateway-infra/maas-api-69f57ff875-j5qjr" Nov 04 07:32:40.780399 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:40.780277 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h2j2\" (UniqueName: \"kubernetes.io/projected/7ede4643-54d3-4cce-b3d3-f5f712530980-kube-api-access-8h2j2\") pod \"maas-api-69f57ff875-j5qjr\" (UID: \"7ede4643-54d3-4cce-b3d3-f5f712530980\") " pod="odh-ai-gateway-infra/maas-api-69f57ff875-j5qjr" Nov 04 07:32:40.780399 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:40.780369 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ede4643-54d3-4cce-b3d3-f5f712530980-openshift-service-ca\") pod \"maas-api-69f57ff875-j5qjr\" (UID: \"7ede4643-54d3-4cce-b3d3-f5f712530980\") " pod="odh-ai-gateway-infra/maas-api-69f57ff875-j5qjr" Nov 04 07:32:40.780399 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:40.780393 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ede4643-54d3-4cce-b3d3-f5f712530980-metrics-certs\") pod \"maas-api-69f57ff875-j5qjr\" (UID: \"7ede4643-54d3-4cce-b3d3-f5f712530980\") " pod="odh-ai-gateway-infra/maas-api-69f57ff875-j5qjr" Nov 04 07:32:40.781030 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:40.781009 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ede4643-54d3-4cce-b3d3-f5f712530980-openshift-service-ca\") pod \"maas-api-69f57ff875-j5qjr\" (UID: \"7ede4643-54d3-4cce-b3d3-f5f712530980\") " pod="odh-ai-gateway-infra/maas-api-69f57ff875-j5qjr" Nov 04 07:32:40.782583 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:40.782564 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ede4643-54d3-4cce-b3d3-f5f712530980-metrics-certs\") pod \"maas-api-69f57ff875-j5qjr\" (UID: \"7ede4643-54d3-4cce-b3d3-f5f712530980\") " pod="odh-ai-gateway-infra/maas-api-69f57ff875-j5qjr" Nov 04 07:32:40.782666 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:40.782619 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ede4643-54d3-4cce-b3d3-f5f712530980-maas-api-tls\") pod \"maas-api-69f57ff875-j5qjr\" (UID: \"7ede4643-54d3-4cce-b3d3-f5f712530980\") " pod="odh-ai-gateway-infra/maas-api-69f57ff875-j5qjr" Nov 04 07:32:40.792447 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:40.792395 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h2j2\" (UniqueName: \"kubernetes.io/projected/7ede4643-54d3-4cce-b3d3-f5f712530980-kube-api-access-8h2j2\") pod \"maas-api-69f57ff875-j5qjr\" (UID: \"7ede4643-54d3-4cce-b3d3-f5f712530980\") " pod="odh-ai-gateway-infra/maas-api-69f57ff875-j5qjr" Nov 04 07:32:40.855529 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:40.855504 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-69f57ff875-j5qjr" Nov 04 07:32:41.132073 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:41.132049 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-69f57ff875-j5qjr"] Nov 04 07:32:41.135367 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:32:41.135331 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ede4643_54d3_4cce_b3d3_f5f712530980.slice/crio-3d043fa894edae352a604c3e412aee21c100eb9a02e16a252fe845d85939f0f0 WatchSource:0}: Error finding container 3d043fa894edae352a604c3e412aee21c100eb9a02e16a252fe845d85939f0f0: Status 404 returned error can't find the container with id 3d043fa894edae352a604c3e412aee21c100eb9a02e16a252fe845d85939f0f0 Nov 04 07:32:41.247756 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:41.247727 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-69f57ff875-j5qjr" event={"ID":"7ede4643-54d3-4cce-b3d3-f5f712530980","Type":"ContainerStarted","Data":"3d043fa894edae352a604c3e412aee21c100eb9a02e16a252fe845d85939f0f0"} Nov 04 07:32:43.607551 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:43.607523 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-pw7r7"] Nov 04 07:32:43.611128 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:43.611108 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-pw7r7" Nov 04 07:32:43.621344 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:43.621149 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-pw7r7"] Nov 04 07:32:43.706350 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:43.706326 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/734fadd0-bd20-46bd-bbca-0bebc35db24d-cert\") pod \"llmisvc-controller-manager-6466c554d8-pw7r7\" (UID: \"734fadd0-bd20-46bd-bbca-0bebc35db24d\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-pw7r7" Nov 04 07:32:43.706485 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:43.706382 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgmtn\" (UniqueName: \"kubernetes.io/projected/734fadd0-bd20-46bd-bbca-0bebc35db24d-kube-api-access-dgmtn\") pod \"llmisvc-controller-manager-6466c554d8-pw7r7\" (UID: \"734fadd0-bd20-46bd-bbca-0bebc35db24d\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-pw7r7" Nov 04 07:32:43.807789 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:43.807724 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/734fadd0-bd20-46bd-bbca-0bebc35db24d-cert\") pod \"llmisvc-controller-manager-6466c554d8-pw7r7\" (UID: \"734fadd0-bd20-46bd-bbca-0bebc35db24d\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-pw7r7" Nov 04 07:32:43.807899 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:43.807792 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgmtn\" (UniqueName: \"kubernetes.io/projected/734fadd0-bd20-46bd-bbca-0bebc35db24d-kube-api-access-dgmtn\") pod \"llmisvc-controller-manager-6466c554d8-pw7r7\" (UID: \"734fadd0-bd20-46bd-bbca-0bebc35db24d\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-pw7r7" Nov 04 07:32:43.810146 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:43.810108 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/734fadd0-bd20-46bd-bbca-0bebc35db24d-cert\") pod \"llmisvc-controller-manager-6466c554d8-pw7r7\" (UID: \"734fadd0-bd20-46bd-bbca-0bebc35db24d\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-pw7r7" Nov 04 07:32:43.819696 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:43.819676 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgmtn\" (UniqueName: \"kubernetes.io/projected/734fadd0-bd20-46bd-bbca-0bebc35db24d-kube-api-access-dgmtn\") pod \"llmisvc-controller-manager-6466c554d8-pw7r7\" (UID: \"734fadd0-bd20-46bd-bbca-0bebc35db24d\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-pw7r7" Nov 04 07:32:43.928625 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:43.928599 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-pw7r7" Nov 04 07:32:44.211528 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:44.211501 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-pw7r7"] Nov 04 07:32:44.213492 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:32:44.213458 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod734fadd0_bd20_46bd_bbca_0bebc35db24d.slice/crio-f30722a9a348f9eab960a3569bac463e82dd556a5c6af2449c82d1bdf92f224d WatchSource:0}: Error finding container f30722a9a348f9eab960a3569bac463e82dd556a5c6af2449c82d1bdf92f224d: Status 404 returned error can't find the container with id f30722a9a348f9eab960a3569bac463e82dd556a5c6af2449c82d1bdf92f224d Nov 04 07:32:44.266190 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:44.266157 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-pw7r7" event={"ID":"734fadd0-bd20-46bd-bbca-0bebc35db24d","Type":"ContainerStarted","Data":"f30722a9a348f9eab960a3569bac463e82dd556a5c6af2449c82d1bdf92f224d"} Nov 04 07:32:44.267717 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:44.267692 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-69f57ff875-j5qjr" event={"ID":"7ede4643-54d3-4cce-b3d3-f5f712530980","Type":"ContainerStarted","Data":"8257dc531fd002a95e1815bf51757576de8ba12cc6b312f0f3a8f2cd217e2eb8"} Nov 04 07:32:44.267845 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:44.267832 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-69f57ff875-j5qjr" Nov 04 07:32:45.273850 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:45.273810 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-pw7r7" event={"ID":"734fadd0-bd20-46bd-bbca-0bebc35db24d","Type":"ContainerStarted","Data":"d18f96750f02015dfa3d6048ca382c6e8849f505af01c890ac5753207c04a987"} Nov 04 07:32:45.274387 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:45.273887 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-pw7r7" Nov 04 07:32:45.294070 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:45.294020 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-69f57ff875-j5qjr" podStartSLOduration=2.953479037 podStartE2EDuration="5.294009994s" totalImagesPullingTime="2.340530957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:32:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:32:44.30545179 +0000 UTC m=+1038.288079964" watchObservedRunningTime="2026-11-04 07:32:45.294009994 +0000 UTC m=+1039.276638186" Nov 04 07:32:45.294722 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:45.294695 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-pw7r7" podStartSLOduration=1.887532345 podStartE2EDuration="2.294687578s" totalImagesPullingTime="407.155233ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:32:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:32:45.291925736 +0000 UTC m=+1039.274553929" watchObservedRunningTime="2026-11-04 07:32:45.294687578 +0000 UTC m=+1039.277315769" Nov 04 07:32:50.278897 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:32:50.278867 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-69f57ff875-j5qjr" Nov 04 07:32:52.140481 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:32:52.140442 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:33:16.281338 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:33:16.281305 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-pw7r7" Nov 04 07:33:16.329482 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:33:16.329448 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-xccjr"] Nov 04 07:33:16.329649 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:33:16.329628 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xccjr" podUID="2328054b-9450-4bb5-98ca-d9a3e49dcd95" containerName="manager" containerID="cri-o://0127e45d69cfafbebf9ed3bb864bd6e2fe6d205941118619d6918d25d62a2499" gracePeriod=30 Nov 04 07:33:16.581420 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:33:16.581397 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xccjr" Nov 04 07:33:16.670020 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:33:16.669991 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2328054b-9450-4bb5-98ca-d9a3e49dcd95-kube-api-access-ds55p\" (UniqueName: \"kubernetes.io/projected/2328054b-9450-4bb5-98ca-d9a3e49dcd95-kube-api-access-ds55p\") pod \"2328054b-9450-4bb5-98ca-d9a3e49dcd95\" (UID: \"2328054b-9450-4bb5-98ca-d9a3e49dcd95\") " Nov 04 07:33:16.670174 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:33:16.670024 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2328054b-9450-4bb5-98ca-d9a3e49dcd95-cert\" (UniqueName: \"kubernetes.io/secret/2328054b-9450-4bb5-98ca-d9a3e49dcd95-cert\") pod \"2328054b-9450-4bb5-98ca-d9a3e49dcd95\" (UID: \"2328054b-9450-4bb5-98ca-d9a3e49dcd95\") " Nov 04 07:33:16.672222 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:33:16.672195 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2328054b-9450-4bb5-98ca-d9a3e49dcd95-cert" pod "2328054b-9450-4bb5-98ca-d9a3e49dcd95" (UID: "2328054b-9450-4bb5-98ca-d9a3e49dcd95"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 07:33:16.672325 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:33:16.672271 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2328054b-9450-4bb5-98ca-d9a3e49dcd95-kube-api-access-ds55p" pod "2328054b-9450-4bb5-98ca-d9a3e49dcd95" (UID: "2328054b-9450-4bb5-98ca-d9a3e49dcd95"). InnerVolumeSpecName "kube-api-access-ds55p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:33:16.771185 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:33:16.771157 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ds55p\" (UniqueName: \"kubernetes.io/projected/2328054b-9450-4bb5-98ca-d9a3e49dcd95-kube-api-access-ds55p\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:33:16.771185 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:33:16.771180 5030 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2328054b-9450-4bb5-98ca-d9a3e49dcd95-cert\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:33:17.433368 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:33:17.433330 5030 generic.go:356] "Generic (PLEG): container finished" podID="2328054b-9450-4bb5-98ca-d9a3e49dcd95" containerID="0127e45d69cfafbebf9ed3bb864bd6e2fe6d205941118619d6918d25d62a2499" exitCode=0 Nov 04 07:33:17.433778 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:33:17.433378 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xccjr" Nov 04 07:33:17.433778 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:33:17.433417 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xccjr" event={"ID":"2328054b-9450-4bb5-98ca-d9a3e49dcd95","Type":"ContainerDied","Data":"0127e45d69cfafbebf9ed3bb864bd6e2fe6d205941118619d6918d25d62a2499"} Nov 04 07:33:17.433778 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:33:17.433470 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-xccjr" event={"ID":"2328054b-9450-4bb5-98ca-d9a3e49dcd95","Type":"ContainerDied","Data":"791ba22d95d6bc23f161824a6a192177edfe681d423531fe90323a6d64f0b6d7"} Nov 04 07:33:17.433778 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:33:17.433492 5030 scope.go:122] "RemoveContainer" containerID="0127e45d69cfafbebf9ed3bb864bd6e2fe6d205941118619d6918d25d62a2499" Nov 04 07:33:17.442584 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:33:17.442568 5030 scope.go:122] "RemoveContainer" containerID="0127e45d69cfafbebf9ed3bb864bd6e2fe6d205941118619d6918d25d62a2499" Nov 04 07:33:17.442843 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:33:17.442814 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0127e45d69cfafbebf9ed3bb864bd6e2fe6d205941118619d6918d25d62a2499\": container with ID starting with 0127e45d69cfafbebf9ed3bb864bd6e2fe6d205941118619d6918d25d62a2499 not found: ID does not exist" containerID="0127e45d69cfafbebf9ed3bb864bd6e2fe6d205941118619d6918d25d62a2499" Nov 04 07:33:17.442910 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:33:17.442842 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0127e45d69cfafbebf9ed3bb864bd6e2fe6d205941118619d6918d25d62a2499"} err="failed to get container status \"0127e45d69cfafbebf9ed3bb864bd6e2fe6d205941118619d6918d25d62a2499\": rpc error: code = NotFound desc = could not find container \"0127e45d69cfafbebf9ed3bb864bd6e2fe6d205941118619d6918d25d62a2499\": container with ID starting with 0127e45d69cfafbebf9ed3bb864bd6e2fe6d205941118619d6918d25d62a2499 not found: ID does not exist" Nov 04 07:33:17.457112 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:33:17.457088 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-xccjr"] Nov 04 07:33:17.461490 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:33:17.461466 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-xccjr"] Nov 04 07:33:18.143625 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:33:18.143592 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2328054b-9450-4bb5-98ca-d9a3e49dcd95" path="/var/lib/kubelet/pods/2328054b-9450-4bb5-98ca-d9a3e49dcd95/volumes" Nov 04 07:33:22.142723 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:33:22.142686 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:33:52.141069 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:33:52.141028 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:33:52.577779 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:33:52.577742 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:33:54.470010 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:33:54.469976 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:33:57.507486 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:33:57.507448 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:34:03.117732 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:03.117692 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:34:15.700166 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.700070 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm"] Nov 04 07:34:15.700513 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.700487 5030 cpu_manager.go:414] "containerMap: removing container" podUID="2328054b-9450-4bb5-98ca-d9a3e49dcd95" containerName="manager" Nov 04 07:34:15.700513 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.700499 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2328054b-9450-4bb5-98ca-d9a3e49dcd95" containerName="manager" Nov 04 07:34:15.700582 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.700565 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="2328054b-9450-4bb5-98ca-d9a3e49dcd95" containerName="manager" Nov 04 07:34:15.703735 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.703710 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.718041 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.718014 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm"] Nov 04 07:34:15.756455 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.756423 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/896d5293-0791-4af3-85b4-ba92315d3616-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.756584 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.756459 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/896d5293-0791-4af3-85b4-ba92315d3616-credential-socket\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.756584 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.756480 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvlbr\" (UniqueName: \"kubernetes.io/projected/896d5293-0791-4af3-85b4-ba92315d3616-kube-api-access-fvlbr\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.756584 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.756549 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/896d5293-0791-4af3-85b4-ba92315d3616-workload-socket\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.756584 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.756579 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/896d5293-0791-4af3-85b4-ba92315d3616-istio-data\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.756789 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.756652 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/896d5293-0791-4af3-85b4-ba92315d3616-istio-envoy\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.756789 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.756709 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/896d5293-0791-4af3-85b4-ba92315d3616-workload-certs\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.756789 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.756739 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/896d5293-0791-4af3-85b4-ba92315d3616-istio-token\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.756951 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.756833 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/896d5293-0791-4af3-85b4-ba92315d3616-istio-podinfo\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.791913 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.791892 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2rn5b\"" Nov 04 07:34:15.857259 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.857235 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/896d5293-0791-4af3-85b4-ba92315d3616-workload-certs\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.857370 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.857261 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/896d5293-0791-4af3-85b4-ba92315d3616-istio-token\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.857370 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.857283 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/896d5293-0791-4af3-85b4-ba92315d3616-istio-podinfo\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.857370 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.857342 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/896d5293-0791-4af3-85b4-ba92315d3616-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.857370 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.857358 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/896d5293-0791-4af3-85b4-ba92315d3616-credential-socket\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.857570 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.857377 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvlbr\" (UniqueName: \"kubernetes.io/projected/896d5293-0791-4af3-85b4-ba92315d3616-kube-api-access-fvlbr\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.857570 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.857407 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/896d5293-0791-4af3-85b4-ba92315d3616-workload-socket\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.857570 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.857430 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/896d5293-0791-4af3-85b4-ba92315d3616-istio-data\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.857570 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.857463 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/896d5293-0791-4af3-85b4-ba92315d3616-istio-envoy\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.857776 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.857635 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/896d5293-0791-4af3-85b4-ba92315d3616-workload-certs\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.857776 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.857705 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/896d5293-0791-4af3-85b4-ba92315d3616-credential-socket\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.857964 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.857942 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/896d5293-0791-4af3-85b4-ba92315d3616-workload-socket\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.858029 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.857983 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/896d5293-0791-4af3-85b4-ba92315d3616-istio-data\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.858208 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.858192 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/896d5293-0791-4af3-85b4-ba92315d3616-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.859593 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.859576 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/896d5293-0791-4af3-85b4-ba92315d3616-istio-envoy\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.860053 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.860035 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/896d5293-0791-4af3-85b4-ba92315d3616-istio-podinfo\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.870178 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.870127 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/896d5293-0791-4af3-85b4-ba92315d3616-istio-token\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:15.870258 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:15.870236 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvlbr\" (UniqueName: \"kubernetes.io/projected/896d5293-0791-4af3-85b4-ba92315d3616-kube-api-access-fvlbr\") pod \"maas-default-gateway-openshift-default-74854d8ccf-5qthm\" (UID: \"896d5293-0791-4af3-85b4-ba92315d3616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:16.017732 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:16.017196 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:16.298833 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:16.298810 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm"] Nov 04 07:34:16.300189 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:34:16.300162 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod896d5293_0791_4af3_85b4_ba92315d3616.slice/crio-bec66e4d2b187d8d21f55fd8aa6c6ff1b397a69a71e6a99f3a40edf5678f8b80 WatchSource:0}: Error finding container bec66e4d2b187d8d21f55fd8aa6c6ff1b397a69a71e6a99f3a40edf5678f8b80: Status 404 returned error can't find the container with id bec66e4d2b187d8d21f55fd8aa6c6ff1b397a69a71e6a99f3a40edf5678f8b80 Nov 04 07:34:16.302284 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:16.302253 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:34:16.302375 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:16.302332 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:34:16.302436 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:16.302377 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:34:16.751528 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:16.751483 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" event={"ID":"896d5293-0791-4af3-85b4-ba92315d3616","Type":"ContainerStarted","Data":"ff9709c43dde93e60ae9f0f05161f88d367ddf901716ee871c101728eeff24aa"} Nov 04 07:34:16.751990 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:16.751598 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" event={"ID":"896d5293-0791-4af3-85b4-ba92315d3616","Type":"ContainerStarted","Data":"bec66e4d2b187d8d21f55fd8aa6c6ff1b397a69a71e6a99f3a40edf5678f8b80"} Nov 04 07:34:16.780910 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:16.780859 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" podStartSLOduration=1.780846499 podStartE2EDuration="1.780846499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:34:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:34:16.778482361 +0000 UTC m=+1130.761110555" watchObservedRunningTime="2026-11-04 07:34:16.780846499 +0000 UTC m=+1130.763474767" Nov 04 07:34:17.031213 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:17.028197 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:17.031213 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:17.028794 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-5qthm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Nov 04 07:34:17.031213 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:17.028850 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" podUID="896d5293-0791-4af3-85b4-ba92315d3616" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Nov 04 07:34:18.019191 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:18.018495 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-5qthm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Nov 04 07:34:18.019191 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:18.018555 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" podUID="896d5293-0791-4af3-85b4-ba92315d3616" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Nov 04 07:34:19.029157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:19.024615 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-5qthm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Nov 04 07:34:19.029157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:19.024681 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" podUID="896d5293-0791-4af3-85b4-ba92315d3616" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Nov 04 07:34:20.018590 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:20.018555 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-5qthm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Nov 04 07:34:20.018862 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:20.018835 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" podUID="896d5293-0791-4af3-85b4-ba92315d3616" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Nov 04 07:34:21.021258 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:21.021221 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-5qthm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Nov 04 07:34:21.022216 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:21.021786 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" podUID="896d5293-0791-4af3-85b4-ba92315d3616" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Nov 04 07:34:22.025159 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:22.021217 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-5qthm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Nov 04 07:34:22.025159 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:22.021277 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" podUID="896d5293-0791-4af3-85b4-ba92315d3616" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Nov 04 07:34:22.152957 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:34:22.152922 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:34:23.018036 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:23.018002 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-5qthm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Nov 04 07:34:23.018360 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:23.018062 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" podUID="896d5293-0791-4af3-85b4-ba92315d3616" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Nov 04 07:34:24.772401 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:24.772363 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:24.772884 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:24.772798 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:24.773675 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:24.773638 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-5qthm" Nov 04 07:34:30.730796 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.730762 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5"] Nov 04 07:34:30.736092 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.736065 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.751257 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.751231 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5"] Nov 04 07:34:30.791346 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.791322 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61a96e7a-6295-45e8-8d2d-f973cb933048-istio-token\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.791469 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.791350 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61a96e7a-6295-45e8-8d2d-f973cb933048-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.791469 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.791372 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61a96e7a-6295-45e8-8d2d-f973cb933048-istio-podinfo\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.791469 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.791452 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktclw\" (UniqueName: \"kubernetes.io/projected/61a96e7a-6295-45e8-8d2d-f973cb933048-kube-api-access-ktclw\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.791609 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.791596 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61a96e7a-6295-45e8-8d2d-f973cb933048-credential-socket\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.791645 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.791625 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61a96e7a-6295-45e8-8d2d-f973cb933048-workload-socket\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.791677 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.791640 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61a96e7a-6295-45e8-8d2d-f973cb933048-istio-envoy\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.791677 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.791662 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61a96e7a-6295-45e8-8d2d-f973cb933048-istio-data\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.791763 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.791743 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61a96e7a-6295-45e8-8d2d-f973cb933048-workload-certs\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.893070 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.893037 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61a96e7a-6295-45e8-8d2d-f973cb933048-credential-socket\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.893070 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.893074 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61a96e7a-6295-45e8-8d2d-f973cb933048-workload-socket\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.893319 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.893090 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61a96e7a-6295-45e8-8d2d-f973cb933048-istio-envoy\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.893319 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.893104 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61a96e7a-6295-45e8-8d2d-f973cb933048-istio-data\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.893319 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.893226 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61a96e7a-6295-45e8-8d2d-f973cb933048-workload-certs\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.893319 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.893309 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61a96e7a-6295-45e8-8d2d-f973cb933048-istio-token\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.893537 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.893331 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61a96e7a-6295-45e8-8d2d-f973cb933048-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.893537 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.893362 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61a96e7a-6295-45e8-8d2d-f973cb933048-istio-podinfo\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.893537 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.893415 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktclw\" (UniqueName: \"kubernetes.io/projected/61a96e7a-6295-45e8-8d2d-f973cb933048-kube-api-access-ktclw\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.893537 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.893518 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61a96e7a-6295-45e8-8d2d-f973cb933048-workload-socket\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.893731 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.893681 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61a96e7a-6295-45e8-8d2d-f973cb933048-credential-socket\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.893784 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.893719 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61a96e7a-6295-45e8-8d2d-f973cb933048-workload-certs\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.893875 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.893850 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61a96e7a-6295-45e8-8d2d-f973cb933048-istio-data\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.894011 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.893993 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61a96e7a-6295-45e8-8d2d-f973cb933048-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.895509 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.895490 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61a96e7a-6295-45e8-8d2d-f973cb933048-istio-envoy\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.895730 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.895713 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61a96e7a-6295-45e8-8d2d-f973cb933048-istio-podinfo\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.907102 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.907082 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktclw\" (UniqueName: \"kubernetes.io/projected/61a96e7a-6295-45e8-8d2d-f973cb933048-kube-api-access-ktclw\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:30.907282 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:30.907262 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61a96e7a-6295-45e8-8d2d-f973cb933048-istio-token\") pod \"maas-default-gateway-openshift-default-74854d8ccf-r7fn5\" (UID: \"61a96e7a-6295-45e8-8d2d-f973cb933048\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:31.048781 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:31.048725 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:31.333864 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:31.333833 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5"] Nov 04 07:34:31.336187 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:34:31.336159 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61a96e7a_6295_45e8_8d2d_f973cb933048.slice/crio-371320030b3447dc7118c97606bc42e343f2823eeb3c8ff5bada2c429ad53c7f WatchSource:0}: Error finding container 371320030b3447dc7118c97606bc42e343f2823eeb3c8ff5bada2c429ad53c7f: Status 404 returned error can't find the container with id 371320030b3447dc7118c97606bc42e343f2823eeb3c8ff5bada2c429ad53c7f Nov 04 07:34:31.338236 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:31.338206 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:34:31.338286 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:31.338269 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:34:31.338375 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:31.338298 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:34:31.840603 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:31.840561 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" event={"ID":"61a96e7a-6295-45e8-8d2d-f973cb933048","Type":"ContainerStarted","Data":"076648adae3b9efd6191b3825034f1a4a4e8f9d5e427597f7327eb43f748c17a"} Nov 04 07:34:31.841004 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:31.840632 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" event={"ID":"61a96e7a-6295-45e8-8d2d-f973cb933048","Type":"ContainerStarted","Data":"371320030b3447dc7118c97606bc42e343f2823eeb3c8ff5bada2c429ad53c7f"} Nov 04 07:34:31.867396 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:31.867347 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" podStartSLOduration=1.867334267 podStartE2EDuration="1.867334267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:34:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:34:31.864662102 +0000 UTC m=+1145.847290297" watchObservedRunningTime="2026-11-04 07:34:31.867334267 +0000 UTC m=+1145.849962459" Nov 04 07:34:32.049737 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:32.049699 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:32.051403 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:32.051378 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-r7fn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Nov 04 07:34:32.051511 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:32.051435 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" podUID="61a96e7a-6295-45e8-8d2d-f973cb933048" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Nov 04 07:34:33.049595 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:33.049558 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-r7fn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Nov 04 07:34:33.049988 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:33.049608 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" podUID="61a96e7a-6295-45e8-8d2d-f973cb933048" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Nov 04 07:34:34.049341 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:34.049307 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-r7fn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Nov 04 07:34:34.049493 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:34.049375 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" podUID="61a96e7a-6295-45e8-8d2d-f973cb933048" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Nov 04 07:34:35.049681 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:35.049645 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-r7fn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Nov 04 07:34:35.050043 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:35.049698 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" podUID="61a96e7a-6295-45e8-8d2d-f973cb933048" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Nov 04 07:34:36.049635 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:36.049596 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-r7fn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Nov 04 07:34:36.049808 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:36.049656 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" podUID="61a96e7a-6295-45e8-8d2d-f973cb933048" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Nov 04 07:34:37.049567 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:37.049532 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-r7fn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Nov 04 07:34:37.049718 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:37.049616 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" podUID="61a96e7a-6295-45e8-8d2d-f973cb933048" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Nov 04 07:34:38.049764 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:38.049730 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-r7fn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Nov 04 07:34:38.050153 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:38.049793 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" podUID="61a96e7a-6295-45e8-8d2d-f973cb933048" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Nov 04 07:34:39.828459 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:39.828425 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:39.829324 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:39.829222 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:39.830096 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:39.830069 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-r7fn5" Nov 04 07:34:52.140020 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:34:52.139981 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:34:53.137367 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:34:53.137331 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:35:00.839958 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:00.839919 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:35:04.830295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:04.830255 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp"] Nov 04 07:35:04.835104 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:04.835081 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp" Nov 04 07:35:04.842590 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:04.842571 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-29d3ee-serving-cert\"" Nov 04 07:35:04.851094 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:04.851072 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp"] Nov 04 07:35:04.913504 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:04.913468 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6a5a285-9b50-4a95-a7db-e920fc79d50a-metrics-certs\") pod \"maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp\" (UID: \"a6a5a285-9b50-4a95-a7db-e920fc79d50a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp" Nov 04 07:35:04.913649 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:04.913515 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpngm\" (UniqueName: \"kubernetes.io/projected/a6a5a285-9b50-4a95-a7db-e920fc79d50a-kube-api-access-cpngm\") pod \"maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp\" (UID: \"a6a5a285-9b50-4a95-a7db-e920fc79d50a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp" Nov 04 07:35:04.913737 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:04.913713 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6a5a285-9b50-4a95-a7db-e920fc79d50a-maas-api-tls\") pod \"maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp\" (UID: \"a6a5a285-9b50-4a95-a7db-e920fc79d50a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp" Nov 04 07:35:04.913797 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:04.913778 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6a5a285-9b50-4a95-a7db-e920fc79d50a-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp\" (UID: \"a6a5a285-9b50-4a95-a7db-e920fc79d50a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp" Nov 04 07:35:05.014814 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:05.014782 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6a5a285-9b50-4a95-a7db-e920fc79d50a-maas-api-tls\") pod \"maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp\" (UID: \"a6a5a285-9b50-4a95-a7db-e920fc79d50a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp" Nov 04 07:35:05.014958 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:05.014825 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6a5a285-9b50-4a95-a7db-e920fc79d50a-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp\" (UID: \"a6a5a285-9b50-4a95-a7db-e920fc79d50a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp" Nov 04 07:35:05.014958 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:05.014860 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6a5a285-9b50-4a95-a7db-e920fc79d50a-metrics-certs\") pod \"maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp\" (UID: \"a6a5a285-9b50-4a95-a7db-e920fc79d50a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp" Nov 04 07:35:05.014958 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:05.014875 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpngm\" (UniqueName: \"kubernetes.io/projected/a6a5a285-9b50-4a95-a7db-e920fc79d50a-kube-api-access-cpngm\") pod \"maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp\" (UID: \"a6a5a285-9b50-4a95-a7db-e920fc79d50a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp" Nov 04 07:35:05.015646 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:05.015618 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6a5a285-9b50-4a95-a7db-e920fc79d50a-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp\" (UID: \"a6a5a285-9b50-4a95-a7db-e920fc79d50a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp" Nov 04 07:35:05.017417 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:05.017393 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6a5a285-9b50-4a95-a7db-e920fc79d50a-metrics-certs\") pod \"maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp\" (UID: \"a6a5a285-9b50-4a95-a7db-e920fc79d50a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp" Nov 04 07:35:05.017515 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:05.017492 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6a5a285-9b50-4a95-a7db-e920fc79d50a-maas-api-tls\") pod \"maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp\" (UID: \"a6a5a285-9b50-4a95-a7db-e920fc79d50a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp" Nov 04 07:35:05.028172 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:05.028146 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpngm\" (UniqueName: \"kubernetes.io/projected/a6a5a285-9b50-4a95-a7db-e920fc79d50a-kube-api-access-cpngm\") pod \"maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp\" (UID: \"a6a5a285-9b50-4a95-a7db-e920fc79d50a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp" Nov 04 07:35:05.153485 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:05.153411 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp" Nov 04 07:35:05.444548 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:05.444521 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp"] Nov 04 07:35:05.446279 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:35:05.446252 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6a5a285_9b50_4a95_a7db_e920fc79d50a.slice/crio-67ebd5bee2c127af35a207fd8ac1a8a731a91f2b31ea31ad9c3000f410fb178e WatchSource:0}: Error finding container 67ebd5bee2c127af35a207fd8ac1a8a731a91f2b31ea31ad9c3000f410fb178e: Status 404 returned error can't find the container with id 67ebd5bee2c127af35a207fd8ac1a8a731a91f2b31ea31ad9c3000f410fb178e Nov 04 07:35:06.028758 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:06.028725 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp" event={"ID":"a6a5a285-9b50-4a95-a7db-e920fc79d50a","Type":"ContainerStarted","Data":"adbfbcb40f00e99f51d86e08644c3d73f1ee129eff4bf61761f18b93d2301eef"} Nov 04 07:35:06.029167 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:06.028775 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp" event={"ID":"a6a5a285-9b50-4a95-a7db-e920fc79d50a","Type":"ContainerStarted","Data":"67ebd5bee2c127af35a207fd8ac1a8a731a91f2b31ea31ad9c3000f410fb178e"} Nov 04 07:35:06.029167 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:06.028931 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp" Nov 04 07:35:06.051527 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:06.051484 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp" podStartSLOduration=1.6154940450000002 podStartE2EDuration="2.051471601s" totalImagesPullingTime="435.977556ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:35:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:35:06.05060343 +0000 UTC m=+1180.033231622" watchObservedRunningTime="2026-11-04 07:35:06.051471601 +0000 UTC m=+1180.034099836" Nov 04 07:35:07.327732 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:07.327691 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:35:12.040414 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:12.040381 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp" Nov 04 07:35:16.492340 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:16.492303 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:35:22.140525 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:35:22.140483 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:35:25.544582 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:25.544542 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:35:26.280756 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:26.280730 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-9k9rx_ecfd331a-08c4-43ac-a58c-9f43935d06ed/console-operator/2.log" Nov 04 07:35:26.283571 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:26.283546 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-9k9rx_ecfd331a-08c4-43ac-a58c-9f43935d06ed/console-operator/2.log" Nov 04 07:35:26.286558 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:26.286524 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4d9w_9084f3dd-8da4-431c-8040-1e268c3fa964/ovn-acl-logging/0.log" Nov 04 07:35:26.295526 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:26.295504 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4d9w_9084f3dd-8da4-431c-8040-1e268c3fa964/ovn-acl-logging/0.log" Nov 04 07:35:33.422201 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:33.422164 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:35:40.971653 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:40.971553 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc"] Nov 04 07:35:40.976548 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:40.976523 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:35:40.988808 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:40.988612 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-df3be8\"/\"kube-root-ca.crt\"" Nov 04 07:35:40.988808 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:40.988627 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-df3be8\"/\"openshift-service-ca.crt\"" Nov 04 07:35:40.988808 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:40.988626 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-df3be8\"/\"premium-w0-df3be8-kserve-self-signed-certs\"" Nov 04 07:35:40.988808 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:40.988749 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-df3be8\"/\"default-dockercfg-s79pk\"" Nov 04 07:35:40.991295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:40.991273 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc"] Nov 04 07:35:41.065026 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:41.064987 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-dshm\") pod \"premium-w0-df3be8-kserve-fc4d5649b-n4ncc\" (UID: \"6d707a40-b0a6-4c4d-a001-10536187e51c\") " pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:35:41.065229 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:41.065073 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-model-cache\") pod \"premium-w0-df3be8-kserve-fc4d5649b-n4ncc\" (UID: \"6d707a40-b0a6-4c4d-a001-10536187e51c\") " pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:35:41.065308 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:41.065282 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d707a40-b0a6-4c4d-a001-10536187e51c-tls-certs\") pod \"premium-w0-df3be8-kserve-fc4d5649b-n4ncc\" (UID: \"6d707a40-b0a6-4c4d-a001-10536187e51c\") " pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:35:41.065364 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:41.065330 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-home\") pod \"premium-w0-df3be8-kserve-fc4d5649b-n4ncc\" (UID: \"6d707a40-b0a6-4c4d-a001-10536187e51c\") " pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:35:41.065493 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:41.065471 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpqct\" (UniqueName: \"kubernetes.io/projected/6d707a40-b0a6-4c4d-a001-10536187e51c-kube-api-access-fpqct\") pod \"premium-w0-df3be8-kserve-fc4d5649b-n4ncc\" (UID: \"6d707a40-b0a6-4c4d-a001-10536187e51c\") " pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:35:41.065556 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:41.065517 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-tmp-dir\") pod \"premium-w0-df3be8-kserve-fc4d5649b-n4ncc\" (UID: \"6d707a40-b0a6-4c4d-a001-10536187e51c\") " pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:35:41.166145 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:41.166073 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d707a40-b0a6-4c4d-a001-10536187e51c-tls-certs\") pod \"premium-w0-df3be8-kserve-fc4d5649b-n4ncc\" (UID: \"6d707a40-b0a6-4c4d-a001-10536187e51c\") " pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:35:41.166358 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:41.166174 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-home\") pod \"premium-w0-df3be8-kserve-fc4d5649b-n4ncc\" (UID: \"6d707a40-b0a6-4c4d-a001-10536187e51c\") " pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:35:41.166358 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:41.166267 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpqct\" (UniqueName: \"kubernetes.io/projected/6d707a40-b0a6-4c4d-a001-10536187e51c-kube-api-access-fpqct\") pod \"premium-w0-df3be8-kserve-fc4d5649b-n4ncc\" (UID: \"6d707a40-b0a6-4c4d-a001-10536187e51c\") " pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:35:41.166358 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:41.166305 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-tmp-dir\") pod \"premium-w0-df3be8-kserve-fc4d5649b-n4ncc\" (UID: \"6d707a40-b0a6-4c4d-a001-10536187e51c\") " pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:35:41.166358 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:41.166352 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-dshm\") pod \"premium-w0-df3be8-kserve-fc4d5649b-n4ncc\" (UID: \"6d707a40-b0a6-4c4d-a001-10536187e51c\") " pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:35:41.166581 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:41.166421 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-model-cache\") pod \"premium-w0-df3be8-kserve-fc4d5649b-n4ncc\" (UID: \"6d707a40-b0a6-4c4d-a001-10536187e51c\") " pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:35:41.166736 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:41.166710 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-home\") pod \"premium-w0-df3be8-kserve-fc4d5649b-n4ncc\" (UID: \"6d707a40-b0a6-4c4d-a001-10536187e51c\") " pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:35:41.166818 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:41.166734 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-tmp-dir\") pod \"premium-w0-df3be8-kserve-fc4d5649b-n4ncc\" (UID: \"6d707a40-b0a6-4c4d-a001-10536187e51c\") " pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:35:41.167054 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:41.167031 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-model-cache\") pod \"premium-w0-df3be8-kserve-fc4d5649b-n4ncc\" (UID: \"6d707a40-b0a6-4c4d-a001-10536187e51c\") " pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:35:41.169023 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:41.169001 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d707a40-b0a6-4c4d-a001-10536187e51c-tls-certs\") pod \"premium-w0-df3be8-kserve-fc4d5649b-n4ncc\" (UID: \"6d707a40-b0a6-4c4d-a001-10536187e51c\") " pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:35:41.169128 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:41.169094 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-dshm\") pod \"premium-w0-df3be8-kserve-fc4d5649b-n4ncc\" (UID: \"6d707a40-b0a6-4c4d-a001-10536187e51c\") " pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:35:41.180447 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:41.180419 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpqct\" (UniqueName: \"kubernetes.io/projected/6d707a40-b0a6-4c4d-a001-10536187e51c-kube-api-access-fpqct\") pod \"premium-w0-df3be8-kserve-fc4d5649b-n4ncc\" (UID: \"6d707a40-b0a6-4c4d-a001-10536187e51c\") " pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:35:41.290954 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:41.290888 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:35:41.566011 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:41.565981 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc"] Nov 04 07:35:41.568338 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:35:41.568306 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d707a40_b0a6_4c4d_a001_10536187e51c.slice/crio-8e1b118831a8d8fa52d7ed90900bcda0ec1cec6ac1f80782325a86ffb1a5b3f5 WatchSource:0}: Error finding container 8e1b118831a8d8fa52d7ed90900bcda0ec1cec6ac1f80782325a86ffb1a5b3f5: Status 404 returned error can't find the container with id 8e1b118831a8d8fa52d7ed90900bcda0ec1cec6ac1f80782325a86ffb1a5b3f5 Nov 04 07:35:42.242500 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:42.242461 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" event={"ID":"6d707a40-b0a6-4c4d-a001-10536187e51c","Type":"ContainerStarted","Data":"8e1b118831a8d8fa52d7ed90900bcda0ec1cec6ac1f80782325a86ffb1a5b3f5"} Nov 04 07:35:43.250676 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:43.250583 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" event={"ID":"6d707a40-b0a6-4c4d-a001-10536187e51c","Type":"ContainerStarted","Data":"207046cc5a850c946e3683f972f207a93024eadbad0caf6a86bdc2362c94454e"} Nov 04 07:35:43.271302 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:43.271244 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" podStartSLOduration=1.872556478 podStartE2EDuration="3.271227232s" totalImagesPullingTime="1.398670754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:35:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:35:43.269518566 +0000 UTC m=+1217.252146759" watchObservedRunningTime="2026-11-04 07:35:43.271227232 +0000 UTC m=+1217.253855426" Nov 04 07:35:43.292002 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:43.291979 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:35:45.612714 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:45.612673 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:35:48.058496 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.058458 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8"] Nov 04 07:35:48.062297 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.062273 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:35:48.069179 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.068964 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-60ed4a\"/\"openshift-service-ca.crt\"" Nov 04 07:35:48.069179 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.069019 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-60ed4a\"/\"premium-w3-60ed4a-kserve-self-signed-certs\"" Nov 04 07:35:48.069179 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.069052 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-60ed4a\"/\"default-dockercfg-zs5mn\"" Nov 04 07:35:48.069179 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.069120 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-60ed4a\"/\"kube-root-ca.crt\"" Nov 04 07:35:48.074930 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.074905 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8"] Nov 04 07:35:48.130892 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.130851 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-tls-certs\") pod \"premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8\" (UID: \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\") " pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:35:48.131082 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.130936 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-home\") pod \"premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8\" (UID: \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\") " pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:35:48.131082 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.131019 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-dshm\") pod \"premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8\" (UID: \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\") " pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:35:48.131082 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.131060 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m7pl\" (UniqueName: \"kubernetes.io/projected/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-kube-api-access-5m7pl\") pod \"premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8\" (UID: \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\") " pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:35:48.131299 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.131203 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-tmp-dir\") pod \"premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8\" (UID: \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\") " pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:35:48.131299 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.131253 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-model-cache\") pod \"premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8\" (UID: \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\") " pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:35:48.232389 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.232342 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-dshm\") pod \"premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8\" (UID: \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\") " pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:35:48.232588 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.232400 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m7pl\" (UniqueName: \"kubernetes.io/projected/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-kube-api-access-5m7pl\") pod \"premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8\" (UID: \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\") " pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:35:48.232588 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.232461 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-tmp-dir\") pod \"premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8\" (UID: \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\") " pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:35:48.232588 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.232529 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-model-cache\") pod \"premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8\" (UID: \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\") " pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:35:48.232766 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.232618 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-tls-certs\") pod \"premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8\" (UID: \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\") " pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:35:48.232766 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.232756 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-home\") pod \"premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8\" (UID: \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\") " pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:35:48.233196 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.233168 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-tmp-dir\") pod \"premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8\" (UID: \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\") " pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:35:48.233720 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.233692 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-model-cache\") pod \"premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8\" (UID: \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\") " pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:35:48.233881 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.233861 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-home\") pod \"premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8\" (UID: \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\") " pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:35:48.235832 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.235810 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-dshm\") pod \"premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8\" (UID: \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\") " pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:35:48.235986 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.235966 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-tls-certs\") pod \"premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8\" (UID: \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\") " pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:35:48.244756 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.244733 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m7pl\" (UniqueName: \"kubernetes.io/projected/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-kube-api-access-5m7pl\") pod \"premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8\" (UID: \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\") " pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:35:48.378530 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.378453 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:35:48.669078 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:48.669052 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8"] Nov 04 07:35:48.670842 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:35:48.670813 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod295a2c1a_9e30_4fd1_a561_ccca72c2cde1.slice/crio-27c7d10294e09917ea88ae2b3a27b379f1a675125015801b1f03190aef62dafd WatchSource:0}: Error finding container 27c7d10294e09917ea88ae2b3a27b379f1a675125015801b1f03190aef62dafd: Status 404 returned error can't find the container with id 27c7d10294e09917ea88ae2b3a27b379f1a675125015801b1f03190aef62dafd Nov 04 07:35:49.289703 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:49.289665 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" event={"ID":"295a2c1a-9e30-4fd1-a561-ccca72c2cde1","Type":"ContainerStarted","Data":"253fb9645bcbd6edbbb81c2b1f12a1befba44a1aef3849509e53ae4554db1fb0"} Nov 04 07:35:49.290191 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:49.289712 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" event={"ID":"295a2c1a-9e30-4fd1-a561-ccca72c2cde1","Type":"ContainerStarted","Data":"27c7d10294e09917ea88ae2b3a27b379f1a675125015801b1f03190aef62dafd"} Nov 04 07:35:49.310649 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:49.310601 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" podStartSLOduration=1.310588539 podStartE2EDuration="1.310588539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:35:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:35:49.309642477 +0000 UTC m=+1223.292270681" watchObservedRunningTime="2026-11-04 07:35:49.310588539 +0000 UTC m=+1223.293216730" Nov 04 07:35:49.379469 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:49.379435 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:35:51.291995 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:51.291963 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:35:51.304487 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:51.304459 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:35:51.324032 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:51.324001 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:35:52.147015 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:35:52.146979 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:35:58.378919 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:58.378886 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:35:58.391638 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:58.391612 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:35:59.274987 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.274953 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g"] Nov 04 07:35:59.279271 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.279245 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.283904 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.283880 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-1f6ce4-openshift-default-dockercfg-vncb8\"" Nov 04 07:35:59.293515 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.293490 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g"] Nov 04 07:35:59.340983 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.340958 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-podinfo\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.341114 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.340998 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-data\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.341175 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.341145 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-workload-certs\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.341213 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.341189 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-token\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.341339 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.341320 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e155c8ba-0187-49e8-b9fd-228502823f6b-istiod-ca-cert\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.341387 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.341351 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-workload-socket\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.341387 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.341378 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-credential-socket\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.341449 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.341412 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-envoy\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.341493 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.341478 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9pbd\" (UniqueName: \"kubernetes.io/projected/e155c8ba-0187-49e8-b9fd-228502823f6b-kube-api-access-w9pbd\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.370533 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.370510 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:35:59.442684 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.442291 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9pbd\" (UniqueName: \"kubernetes.io/projected/e155c8ba-0187-49e8-b9fd-228502823f6b-kube-api-access-w9pbd\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.443171 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.442734 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-podinfo\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.443171 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.442804 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-data\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.443171 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.442881 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-workload-certs\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.443171 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.442910 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-token\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.443171 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.442994 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e155c8ba-0187-49e8-b9fd-228502823f6b-istiod-ca-cert\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.443171 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.443025 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-workload-socket\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.443171 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.443056 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-credential-socket\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.443171 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.443081 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-envoy\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.444424 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.444393 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-data\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.444583 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.444560 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-workload-certs\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.444877 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.444857 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-workload-socket\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.445123 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.445101 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-credential-socket\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.446125 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.446100 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e155c8ba-0187-49e8-b9fd-228502823f6b-istiod-ca-cert\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.446606 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.446584 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-envoy\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.449628 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.449601 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-podinfo\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.454592 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.454567 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9pbd\" (UniqueName: \"kubernetes.io/projected/e155c8ba-0187-49e8-b9fd-228502823f6b-kube-api-access-w9pbd\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.456056 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.456036 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-token\") pod \"e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.593012 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.592920 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:35:59.878618 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.878591 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g"] Nov 04 07:35:59.879840 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:35:59.879803 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode155c8ba_0187_49e8_b9fd_228502823f6b.slice/crio-ce0d24457defe23d2801cc3e047c4d5fb4885e398e3f58b0e0bcddc5806aa3e1 WatchSource:0}: Error finding container ce0d24457defe23d2801cc3e047c4d5fb4885e398e3f58b0e0bcddc5806aa3e1: Status 404 returned error can't find the container with id ce0d24457defe23d2801cc3e047c4d5fb4885e398e3f58b0e0bcddc5806aa3e1 Nov 04 07:35:59.882208 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.882178 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:35:59.882282 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.882237 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:35:59.882282 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:35:59.882265 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:36:00.374365 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:00.374329 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" event={"ID":"e155c8ba-0187-49e8-b9fd-228502823f6b","Type":"ContainerStarted","Data":"3573923df5a55b4143b971a464b7312d74b9ca0af2f77cf0b9928a878e8b0fe2"} Nov 04 07:36:00.374522 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:00.374416 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" event={"ID":"e155c8ba-0187-49e8-b9fd-228502823f6b","Type":"ContainerStarted","Data":"ce0d24457defe23d2801cc3e047c4d5fb4885e398e3f58b0e0bcddc5806aa3e1"} Nov 04 07:36:00.401781 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:00.401736 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" podStartSLOduration=1.40172336 podStartE2EDuration="1.40172336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:35:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:36:00.399380517 +0000 UTC m=+1234.382008911" watchObservedRunningTime="2026-11-04 07:36:00.40172336 +0000 UTC m=+1234.384351546" Nov 04 07:36:00.593518 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:00.593488 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:36:00.595121 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:00.595092 5030 patch_prober.go:29] interesting pod/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Nov 04 07:36:00.595255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:00.595165 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" podUID="e155c8ba-0187-49e8-b9fd-228502823f6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Nov 04 07:36:01.503603 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:01.503569 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:36:01.593960 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:01.593923 5030 patch_prober.go:29] interesting pod/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Nov 04 07:36:01.594467 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:01.594007 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" podUID="e155c8ba-0187-49e8-b9fd-228502823f6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Nov 04 07:36:02.593952 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:02.593916 5030 patch_prober.go:29] interesting pod/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Nov 04 07:36:02.594186 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:02.593979 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" podUID="e155c8ba-0187-49e8-b9fd-228502823f6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Nov 04 07:36:03.594091 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:03.594049 5030 patch_prober.go:29] interesting pod/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Nov 04 07:36:03.594317 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:03.594113 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" podUID="e155c8ba-0187-49e8-b9fd-228502823f6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Nov 04 07:36:04.593997 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:04.593965 5030 patch_prober.go:29] interesting pod/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Nov 04 07:36:04.594337 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:04.594022 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" podUID="e155c8ba-0187-49e8-b9fd-228502823f6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Nov 04 07:36:05.593751 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:05.593712 5030 patch_prober.go:29] interesting pod/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Nov 04 07:36:05.593943 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:05.593772 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" podUID="e155c8ba-0187-49e8-b9fd-228502823f6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Nov 04 07:36:07.439144 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:07.439095 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:36:07.439629 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:07.439400 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:36:07.440348 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:07.440326 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:36:20.606715 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:20.606673 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:36:22.141402 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:36:22.141358 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:36:44.839572 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:44.839531 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:36:51.414694 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.414664 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs"] Nov 04 07:36:51.419501 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.419480 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:36:51.430505 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.430479 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs"] Nov 04 07:36:51.430658 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.430643 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-df3be8\"/\"distinct-w0-df3be8-kserve-self-signed-certs\"" Nov 04 07:36:51.547046 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.546996 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-tmp-dir\") pod \"distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs\" (UID: \"0b28a1b0-7560-46f8-b0af-03eb3a196958\") " pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:36:51.547266 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.547071 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b28a1b0-7560-46f8-b0af-03eb3a196958-tls-certs\") pod \"distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs\" (UID: \"0b28a1b0-7560-46f8-b0af-03eb3a196958\") " pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:36:51.547266 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.547101 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-dshm\") pod \"distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs\" (UID: \"0b28a1b0-7560-46f8-b0af-03eb3a196958\") " pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:36:51.547414 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.547277 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv9f6\" (UniqueName: \"kubernetes.io/projected/0b28a1b0-7560-46f8-b0af-03eb3a196958-kube-api-access-zv9f6\") pod \"distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs\" (UID: \"0b28a1b0-7560-46f8-b0af-03eb3a196958\") " pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:36:51.547414 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.547309 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-home\") pod \"distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs\" (UID: \"0b28a1b0-7560-46f8-b0af-03eb3a196958\") " pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:36:51.547414 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.547353 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-model-cache\") pod \"distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs\" (UID: \"0b28a1b0-7560-46f8-b0af-03eb3a196958\") " pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:36:51.648115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.648081 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-model-cache\") pod \"distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs\" (UID: \"0b28a1b0-7560-46f8-b0af-03eb3a196958\") " pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:36:51.648350 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.648169 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-tmp-dir\") pod \"distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs\" (UID: \"0b28a1b0-7560-46f8-b0af-03eb3a196958\") " pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:36:51.648350 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.648199 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b28a1b0-7560-46f8-b0af-03eb3a196958-tls-certs\") pod \"distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs\" (UID: \"0b28a1b0-7560-46f8-b0af-03eb3a196958\") " pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:36:51.648350 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.648217 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-dshm\") pod \"distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs\" (UID: \"0b28a1b0-7560-46f8-b0af-03eb3a196958\") " pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:36:51.648508 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.648410 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv9f6\" (UniqueName: \"kubernetes.io/projected/0b28a1b0-7560-46f8-b0af-03eb3a196958-kube-api-access-zv9f6\") pod \"distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs\" (UID: \"0b28a1b0-7560-46f8-b0af-03eb3a196958\") " pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:36:51.648580 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.648551 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-model-cache\") pod \"distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs\" (UID: \"0b28a1b0-7560-46f8-b0af-03eb3a196958\") " pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:36:51.648659 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.648637 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-home\") pod \"distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs\" (UID: \"0b28a1b0-7560-46f8-b0af-03eb3a196958\") " pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:36:51.648717 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.648676 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-tmp-dir\") pod \"distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs\" (UID: \"0b28a1b0-7560-46f8-b0af-03eb3a196958\") " pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:36:51.648977 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.648960 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-home\") pod \"distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs\" (UID: \"0b28a1b0-7560-46f8-b0af-03eb3a196958\") " pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:36:51.650530 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.650509 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-dshm\") pod \"distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs\" (UID: \"0b28a1b0-7560-46f8-b0af-03eb3a196958\") " pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:36:51.650836 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.650786 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b28a1b0-7560-46f8-b0af-03eb3a196958-tls-certs\") pod \"distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs\" (UID: \"0b28a1b0-7560-46f8-b0af-03eb3a196958\") " pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:36:51.661252 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.661231 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv9f6\" (UniqueName: \"kubernetes.io/projected/0b28a1b0-7560-46f8-b0af-03eb3a196958-kube-api-access-zv9f6\") pod \"distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs\" (UID: \"0b28a1b0-7560-46f8-b0af-03eb3a196958\") " pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:36:51.738014 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.737984 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:36:51.883845 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.883808 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-11453-a07e6d"] Nov 04 07:36:51.888778 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.888752 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-11453-a07e6d" Nov 04 07:36:51.893250 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.892808 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-dztgd\"" Nov 04 07:36:51.894431 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.894402 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-11453-a07e6d"] Nov 04 07:36:51.953002 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:51.952966 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmktd\" (UniqueName: \"kubernetes.io/projected/6bc4cc9c-7432-442e-8780-d2dc35a1a861-kube-api-access-wmktd\") pod \"test-curl-11453-a07e6d\" (UID: \"6bc4cc9c-7432-442e-8780-d2dc35a1a861\") " pod="opendatahub/test-curl-11453-a07e6d" Nov 04 07:36:52.027218 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:52.027192 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs"] Nov 04 07:36:52.029575 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:36:52.029545 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b28a1b0_7560_46f8_b0af_03eb3a196958.slice/crio-89f96465b6d0bb54167eb8f0ebcf284bf2eb485c996119ab31c779affadcc106 WatchSource:0}: Error finding container 89f96465b6d0bb54167eb8f0ebcf284bf2eb485c996119ab31c779affadcc106: Status 404 returned error can't find the container with id 89f96465b6d0bb54167eb8f0ebcf284bf2eb485c996119ab31c779affadcc106 Nov 04 07:36:52.053465 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:52.053438 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmktd\" (UniqueName: \"kubernetes.io/projected/6bc4cc9c-7432-442e-8780-d2dc35a1a861-kube-api-access-wmktd\") pod \"test-curl-11453-a07e6d\" (UID: \"6bc4cc9c-7432-442e-8780-d2dc35a1a861\") " pod="opendatahub/test-curl-11453-a07e6d" Nov 04 07:36:52.065516 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:52.065494 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmktd\" (UniqueName: \"kubernetes.io/projected/6bc4cc9c-7432-442e-8780-d2dc35a1a861-kube-api-access-wmktd\") pod \"test-curl-11453-a07e6d\" (UID: \"6bc4cc9c-7432-442e-8780-d2dc35a1a861\") " pod="opendatahub/test-curl-11453-a07e6d" Nov 04 07:36:52.141879 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:36:52.141833 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:36:52.204948 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:52.204917 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-11453-a07e6d" Nov 04 07:36:52.484597 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:52.484560 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-11453-a07e6d"] Nov 04 07:36:52.489698 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:36:52.489672 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bc4cc9c_7432_442e_8780_d2dc35a1a861.slice/crio-cc682323f6c36c8e3452be1964f72866b160c9e1d6841eaccdface032185979f WatchSource:0}: Error finding container cc682323f6c36c8e3452be1964f72866b160c9e1d6841eaccdface032185979f: Status 404 returned error can't find the container with id cc682323f6c36c8e3452be1964f72866b160c9e1d6841eaccdface032185979f Nov 04 07:36:52.491691 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:52.491674 5030 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 07:36:52.673299 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:52.673255 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" event={"ID":"0b28a1b0-7560-46f8-b0af-03eb3a196958","Type":"ContainerStarted","Data":"0cc73dc26fa1709f2492cc9c5e9acfc8031178de1bf9733416d73af770fb1b16"} Nov 04 07:36:52.673475 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:52.673306 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" event={"ID":"0b28a1b0-7560-46f8-b0af-03eb3a196958","Type":"ContainerStarted","Data":"89f96465b6d0bb54167eb8f0ebcf284bf2eb485c996119ab31c779affadcc106"} Nov 04 07:36:52.674779 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:52.674747 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-11453-a07e6d" event={"ID":"6bc4cc9c-7432-442e-8780-d2dc35a1a861","Type":"ContainerStarted","Data":"cc682323f6c36c8e3452be1964f72866b160c9e1d6841eaccdface032185979f"} Nov 04 07:36:52.693537 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:52.693497 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" podStartSLOduration=1.693483843 podStartE2EDuration="1.693483843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:36:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:36:52.692174091 +0000 UTC m=+1286.674802283" watchObservedRunningTime="2026-11-04 07:36:52.693483843 +0000 UTC m=+1286.676112035" Nov 04 07:36:52.738860 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:52.738803 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:36:53.682156 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:53.682099 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-11453-a07e6d" event={"ID":"6bc4cc9c-7432-442e-8780-d2dc35a1a861","Type":"ContainerStarted","Data":"76ea5c8d05c27d8c0d11f1e7babd0cc4466ac710c63251901e83e2136d936228"} Nov 04 07:36:53.717708 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:53.717615 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-11453-a07e6d" podStartSLOduration=1.750199184 podStartE2EDuration="2.717602253s" totalImagesPullingTime="967.403069ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:36:53.716509658 +0000 UTC m=+1287.699137853" watchObservedRunningTime="2026-11-04 07:36:53.717602253 +0000 UTC m=+1287.700230445" Nov 04 07:36:54.383170 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:54.383128 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-11453-a07e6d"] Nov 04 07:36:54.388207 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:54.388176 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-11453-a07e6d"] Nov 04 07:36:54.539329 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:54.539296 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-11453-5385ed"] Nov 04 07:36:54.539969 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:54.539947 5030 cpu_manager.go:414] "containerMap: removing container" podUID="6bc4cc9c-7432-442e-8780-d2dc35a1a861" containerName="test-curl-11453-a07e6d" Nov 04 07:36:54.540067 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:54.539969 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6bc4cc9c-7432-442e-8780-d2dc35a1a861" containerName="test-curl-11453-a07e6d" Nov 04 07:36:54.540125 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:54.540115 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="6bc4cc9c-7432-442e-8780-d2dc35a1a861" containerName="test-curl-11453-a07e6d" Nov 04 07:36:54.543787 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:54.543770 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-11453-5385ed" Nov 04 07:36:54.550618 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:54.550595 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-11453-5385ed"] Nov 04 07:36:54.680747 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:54.680713 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8k5j\" (UniqueName: \"kubernetes.io/projected/68bfc6ed-a835-4487-8f76-49d3a8013447-kube-api-access-n8k5j\") pod \"test-curl-11453-5385ed\" (UID: \"68bfc6ed-a835-4487-8f76-49d3a8013447\") " pod="opendatahub/test-curl-11453-5385ed" Nov 04 07:36:54.781629 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:54.781596 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8k5j\" (UniqueName: \"kubernetes.io/projected/68bfc6ed-a835-4487-8f76-49d3a8013447-kube-api-access-n8k5j\") pod \"test-curl-11453-5385ed\" (UID: \"68bfc6ed-a835-4487-8f76-49d3a8013447\") " pod="opendatahub/test-curl-11453-5385ed" Nov 04 07:36:54.793781 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:54.793758 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8k5j\" (UniqueName: \"kubernetes.io/projected/68bfc6ed-a835-4487-8f76-49d3a8013447-kube-api-access-n8k5j\") pod \"test-curl-11453-5385ed\" (UID: \"68bfc6ed-a835-4487-8f76-49d3a8013447\") " pod="opendatahub/test-curl-11453-5385ed" Nov 04 07:36:54.859328 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:54.859300 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-11453-5385ed" Nov 04 07:36:55.135765 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:55.135735 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-11453-5385ed"] Nov 04 07:36:55.136540 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:36:55.136508 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68bfc6ed_a835_4487_8f76_49d3a8013447.slice/crio-1e87850742d91688c03877d366c8b08161e83af315003f2458ab00ce8b390585 WatchSource:0}: Error finding container 1e87850742d91688c03877d366c8b08161e83af315003f2458ab00ce8b390585: Status 404 returned error can't find the container with id 1e87850742d91688c03877d366c8b08161e83af315003f2458ab00ce8b390585 Nov 04 07:36:55.697382 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:55.697346 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-11453-5385ed" event={"ID":"68bfc6ed-a835-4487-8f76-49d3a8013447","Type":"ContainerStarted","Data":"10005c29905a2a84ad1eed6d964e7eb3079d3b31e5ef794b3ea39ca65b3ffdad"} Nov 04 07:36:55.697382 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:55.697388 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-11453-5385ed" event={"ID":"68bfc6ed-a835-4487-8f76-49d3a8013447","Type":"ContainerStarted","Data":"1e87850742d91688c03877d366c8b08161e83af315003f2458ab00ce8b390585"} Nov 04 07:36:55.697626 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:55.697412 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-11453-a07e6d" podUID="6bc4cc9c-7432-442e-8780-d2dc35a1a861" containerName="test-curl-11453-a07e6d" containerID="cri-o://76ea5c8d05c27d8c0d11f1e7babd0cc4466ac710c63251901e83e2136d936228" gracePeriod=2 Nov 04 07:36:55.716946 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:55.716491 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-11453-5385ed" podStartSLOduration=1.716281588 podStartE2EDuration="1.716281588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:36:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:36:55.712929376 +0000 UTC m=+1289.695557567" watchObservedRunningTime="2026-11-04 07:36:55.716281588 +0000 UTC m=+1289.698909780" Nov 04 07:36:55.726235 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:36:55.725427 5030 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-11453-a07e6d\" is forbidden: User \"system:node:ip-10-0-130-91.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-91.us-east-2.compute.internal' and this object" podUID="6bc4cc9c-7432-442e-8780-d2dc35a1a861" pod="opendatahub/test-curl-11453-a07e6d" Nov 04 07:36:55.728203 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:36:55.728176 5030 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-11453-a07e6d\" is forbidden: User \"system:node:ip-10-0-130-91.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-91.us-east-2.compute.internal' and this object" podUID="6bc4cc9c-7432-442e-8780-d2dc35a1a861" pod="opendatahub/test-curl-11453-a07e6d" Nov 04 07:36:56.143793 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:36:56.143706 5030 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-11453-a07e6d\" is forbidden: User \"system:node:ip-10-0-130-91.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-91.us-east-2.compute.internal' and this object" podUID="6bc4cc9c-7432-442e-8780-d2dc35a1a861" pod="opendatahub/test-curl-11453-a07e6d" Nov 04 07:36:56.243306 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:36:56.243263 5030 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:52972->127.0.0.1:35897: write tcp 127.0.0.1:52972->127.0.0.1:35897: write: broken pipe Nov 04 07:36:56.286986 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:56.286918 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:36:56.401057 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:56.400986 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-11453-5385ed"] Nov 04 07:36:56.407256 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:56.407227 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-11453-5385ed"] Nov 04 07:36:57.710125 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:57.709966 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-11453-5385ed" podUID="68bfc6ed-a835-4487-8f76-49d3a8013447" containerName="test-curl-11453-5385ed" containerID="cri-o://10005c29905a2a84ad1eed6d964e7eb3079d3b31e5ef794b3ea39ca65b3ffdad" gracePeriod=2 Nov 04 07:36:57.714284 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:36:57.714253 5030 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-11453-5385ed\" is forbidden: User \"system:node:ip-10-0-130-91.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-91.us-east-2.compute.internal' and this object" podUID="68bfc6ed-a835-4487-8f76-49d3a8013447" pod="opendatahub/test-curl-11453-5385ed" Nov 04 07:36:57.856555 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:57.856530 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-11453-a07e6d" Nov 04 07:36:57.859331 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:36:57.859296 5030 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-11453-5385ed\" is forbidden: User \"system:node:ip-10-0-130-91.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-91.us-east-2.compute.internal' and this object" podUID="68bfc6ed-a835-4487-8f76-49d3a8013447" pod="opendatahub/test-curl-11453-5385ed" Nov 04 07:36:57.912899 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:57.912877 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6bc4cc9c-7432-442e-8780-d2dc35a1a861-kube-api-access-wmktd\" (UniqueName: \"kubernetes.io/projected/6bc4cc9c-7432-442e-8780-d2dc35a1a861-kube-api-access-wmktd\") pod \"6bc4cc9c-7432-442e-8780-d2dc35a1a861\" (UID: \"6bc4cc9c-7432-442e-8780-d2dc35a1a861\") " Nov 04 07:36:57.914953 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:57.914930 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bc4cc9c-7432-442e-8780-d2dc35a1a861-kube-api-access-wmktd" pod "6bc4cc9c-7432-442e-8780-d2dc35a1a861" (UID: "6bc4cc9c-7432-442e-8780-d2dc35a1a861"). InnerVolumeSpecName "kube-api-access-wmktd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:36:58.013914 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.013835 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmktd\" (UniqueName: \"kubernetes.io/projected/6bc4cc9c-7432-442e-8780-d2dc35a1a861-kube-api-access-wmktd\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:36:58.144888 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.144855 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6bc4cc9c-7432-442e-8780-d2dc35a1a861" path="/var/lib/kubelet/pods/6bc4cc9c-7432-442e-8780-d2dc35a1a861/volumes" Nov 04 07:36:58.494449 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.494400 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2"] Nov 04 07:36:58.495081 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.495063 5030 cpu_manager.go:414] "containerMap: removing container" podUID="68bfc6ed-a835-4487-8f76-49d3a8013447" containerName="test-curl-11453-5385ed" Nov 04 07:36:58.495161 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.495083 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="68bfc6ed-a835-4487-8f76-49d3a8013447" containerName="test-curl-11453-5385ed" Nov 04 07:36:58.495267 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.495254 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="68bfc6ed-a835-4487-8f76-49d3a8013447" containerName="test-curl-11453-5385ed" Nov 04 07:36:58.499007 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.498986 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.509726 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.509707 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-extmod-a-6dd194-openshift-default-dockercfg-c9nqk\"" Nov 04 07:36:58.528840 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.526973 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2"] Nov 04 07:36:58.621158 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.620395 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-workload-socket\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.621158 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.620457 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-token\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.621158 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.620519 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-workload-certs\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.621158 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.620561 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-data\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.621158 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.620611 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istiod-ca-cert\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.621158 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.620667 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-credential-socket\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.621158 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.620710 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-podinfo\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.621158 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.620757 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hs4j\" (UniqueName: \"kubernetes.io/projected/5eb6bbdd-461f-448e-8dee-3e54fd978d09-kube-api-access-2hs4j\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.621158 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.620787 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-envoy\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.720163 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.719056 5030 generic.go:356] "Generic (PLEG): container finished" podID="6bc4cc9c-7432-442e-8780-d2dc35a1a861" containerID="76ea5c8d05c27d8c0d11f1e7babd0cc4466ac710c63251901e83e2136d936228" exitCode=137 Nov 04 07:36:58.720163 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.719143 5030 scope.go:122] "RemoveContainer" containerID="76ea5c8d05c27d8c0d11f1e7babd0cc4466ac710c63251901e83e2136d936228" Nov 04 07:36:58.720163 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.719165 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-11453-a07e6d" Nov 04 07:36:58.722308 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.722179 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istiod-ca-cert\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.722308 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.722251 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-credential-socket\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.722308 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.722300 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-podinfo\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.722536 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.722348 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hs4j\" (UniqueName: \"kubernetes.io/projected/5eb6bbdd-461f-448e-8dee-3e54fd978d09-kube-api-access-2hs4j\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.722536 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.722377 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-envoy\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.722536 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.722412 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-workload-socket\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.722536 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.722447 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-token\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.722536 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.722513 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-workload-certs\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.722778 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.722559 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-data\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.723965 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.722928 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istiod-ca-cert\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.723965 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.722931 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-data\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.723965 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.723482 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-credential-socket\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.724491 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.724463 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-workload-certs\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.724627 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.724609 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-workload-socket\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.726271 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.726239 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-envoy\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.726652 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.726628 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-podinfo\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.730570 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.730496 5030 scope.go:122] "RemoveContainer" containerID="76ea5c8d05c27d8c0d11f1e7babd0cc4466ac710c63251901e83e2136d936228" Nov 04 07:36:58.730931 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:36:58.730903 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76ea5c8d05c27d8c0d11f1e7babd0cc4466ac710c63251901e83e2136d936228\": container with ID starting with 76ea5c8d05c27d8c0d11f1e7babd0cc4466ac710c63251901e83e2136d936228 not found: ID does not exist" containerID="76ea5c8d05c27d8c0d11f1e7babd0cc4466ac710c63251901e83e2136d936228" Nov 04 07:36:58.731003 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.730943 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76ea5c8d05c27d8c0d11f1e7babd0cc4466ac710c63251901e83e2136d936228"} err="failed to get container status \"76ea5c8d05c27d8c0d11f1e7babd0cc4466ac710c63251901e83e2136d936228\": rpc error: code = NotFound desc = could not find container \"76ea5c8d05c27d8c0d11f1e7babd0cc4466ac710c63251901e83e2136d936228\": container with ID starting with 76ea5c8d05c27d8c0d11f1e7babd0cc4466ac710c63251901e83e2136d936228 not found: ID does not exist" Nov 04 07:36:58.738335 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.738312 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-token\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.739004 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.738974 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hs4j\" (UniqueName: \"kubernetes.io/projected/5eb6bbdd-461f-448e-8dee-3e54fd978d09-kube-api-access-2hs4j\") pod \"e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:58.821400 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:58.821050 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:59.118850 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.118810 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2"] Nov 04 07:36:59.119833 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:36:59.119802 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eb6bbdd_461f_448e_8dee_3e54fd978d09.slice/crio-f905bff104c9c2b1b5168052a0274aa4157f6e8624000c81d8fe823fa41a6e6f WatchSource:0}: Error finding container f905bff104c9c2b1b5168052a0274aa4157f6e8624000c81d8fe823fa41a6e6f: Status 404 returned error can't find the container with id f905bff104c9c2b1b5168052a0274aa4157f6e8624000c81d8fe823fa41a6e6f Nov 04 07:36:59.122922 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.122884 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:36:59.123026 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.122974 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:36:59.123026 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.123013 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:36:59.226925 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.226891 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p"] Nov 04 07:36:59.233766 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.233665 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.249930 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.249864 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p"] Nov 04 07:36:59.290951 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.283636 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-016e6c-openshift-default-dockercfg-d2ms9\"" Nov 04 07:36:59.342352 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.342318 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-podinfo\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.342629 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.342596 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-credential-socket\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.342821 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.342793 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5aae1be-49b8-40dc-8caf-45420865f70b-istiod-ca-cert\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.342969 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.342952 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-token\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.343088 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.343073 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-workload-socket\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.343364 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.343336 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fpf4\" (UniqueName: \"kubernetes.io/projected/b5aae1be-49b8-40dc-8caf-45420865f70b-kube-api-access-6fpf4\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.343454 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.343396 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-workload-certs\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.343454 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.343441 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-envoy\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.343598 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.343465 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-data\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.446230 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.444989 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-podinfo\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.446230 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.445064 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-credential-socket\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.446230 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.445117 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5aae1be-49b8-40dc-8caf-45420865f70b-istiod-ca-cert\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.446230 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.445173 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-token\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.446230 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.445200 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-workload-socket\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.446230 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.445248 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fpf4\" (UniqueName: \"kubernetes.io/projected/b5aae1be-49b8-40dc-8caf-45420865f70b-kube-api-access-6fpf4\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.446230 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.445291 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-workload-certs\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.446230 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.445332 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-envoy\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.446230 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.445357 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-data\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.446230 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.445761 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-data\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.448880 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.447226 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-workload-certs\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.448880 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.448584 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5aae1be-49b8-40dc-8caf-45420865f70b-istiod-ca-cert\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.448880 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.448631 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-credential-socket\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.449837 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.449791 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-podinfo\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.449982 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.449955 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-envoy\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.450346 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.450321 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-workload-socket\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.459599 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.459577 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fpf4\" (UniqueName: \"kubernetes.io/projected/b5aae1be-49b8-40dc-8caf-45420865f70b-kube-api-access-6fpf4\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.460070 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.460051 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-token\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.551922 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.551875 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:36:59.729449 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.729419 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" event={"ID":"5eb6bbdd-461f-448e-8dee-3e54fd978d09","Type":"ContainerStarted","Data":"38fc708ad0db4ff640841377205d916f33ac04fc8772d91b6c1618fd13d26a44"} Nov 04 07:36:59.729849 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.729481 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" event={"ID":"5eb6bbdd-461f-448e-8dee-3e54fd978d09","Type":"ContainerStarted","Data":"f905bff104c9c2b1b5168052a0274aa4157f6e8624000c81d8fe823fa41a6e6f"} Nov 04 07:36:59.822171 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.822073 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:36:59.851718 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.851657 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" podStartSLOduration=1.8516377830000001 podStartE2EDuration="1.851637783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:36:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:36:59.75553303 +0000 UTC m=+1293.738161223" watchObservedRunningTime="2026-11-04 07:36:59.851637783 +0000 UTC m=+1293.834265976" Nov 04 07:36:59.853580 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.853558 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p"] Nov 04 07:36:59.857526 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:36:59.857496 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5aae1be_49b8_40dc_8caf_45420865f70b.slice/crio-031de0ed9fa3b94c26dc921d0183e9830e490b8279b088f7472466e403c974dc WatchSource:0}: Error finding container 031de0ed9fa3b94c26dc921d0183e9830e490b8279b088f7472466e403c974dc: Status 404 returned error can't find the container with id 031de0ed9fa3b94c26dc921d0183e9830e490b8279b088f7472466e403c974dc Nov 04 07:36:59.860658 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.860621 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:36:59.860972 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.860948 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:36:59.861116 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.861100 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:36:59.978608 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:36:59.978579 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-11453-5385ed" Nov 04 07:37:00.052155 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:00.051483 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/68bfc6ed-a835-4487-8f76-49d3a8013447-kube-api-access-n8k5j\" (UniqueName: \"kubernetes.io/projected/68bfc6ed-a835-4487-8f76-49d3a8013447-kube-api-access-n8k5j\") pod \"68bfc6ed-a835-4487-8f76-49d3a8013447\" (UID: \"68bfc6ed-a835-4487-8f76-49d3a8013447\") " Nov 04 07:37:00.058184 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:00.055464 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68bfc6ed-a835-4487-8f76-49d3a8013447-kube-api-access-n8k5j" pod "68bfc6ed-a835-4487-8f76-49d3a8013447" (UID: "68bfc6ed-a835-4487-8f76-49d3a8013447"). InnerVolumeSpecName "kube-api-access-n8k5j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:37:00.148113 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:00.148077 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="68bfc6ed-a835-4487-8f76-49d3a8013447" path="/var/lib/kubelet/pods/68bfc6ed-a835-4487-8f76-49d3a8013447/volumes" Nov 04 07:37:00.157161 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:00.153169 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8k5j\" (UniqueName: \"kubernetes.io/projected/68bfc6ed-a835-4487-8f76-49d3a8013447-kube-api-access-n8k5j\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:37:00.748162 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:00.747588 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" event={"ID":"b5aae1be-49b8-40dc-8caf-45420865f70b","Type":"ContainerStarted","Data":"a2486b2edd8afde205a994406b7123b84329058d50c79421c9f972d4415164d8"} Nov 04 07:37:00.748162 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:00.747654 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" event={"ID":"b5aae1be-49b8-40dc-8caf-45420865f70b","Type":"ContainerStarted","Data":"031de0ed9fa3b94c26dc921d0183e9830e490b8279b088f7472466e403c974dc"} Nov 04 07:37:00.748869 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:00.748840 5030 generic.go:356] "Generic (PLEG): container finished" podID="68bfc6ed-a835-4487-8f76-49d3a8013447" containerID="10005c29905a2a84ad1eed6d964e7eb3079d3b31e5ef794b3ea39ca65b3ffdad" exitCode=137 Nov 04 07:37:00.748973 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:00.748887 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-11453-5385ed" Nov 04 07:37:00.748973 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:00.748929 5030 scope.go:122] "RemoveContainer" containerID="10005c29905a2a84ad1eed6d964e7eb3079d3b31e5ef794b3ea39ca65b3ffdad" Nov 04 07:37:00.759671 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:00.759651 5030 scope.go:122] "RemoveContainer" containerID="10005c29905a2a84ad1eed6d964e7eb3079d3b31e5ef794b3ea39ca65b3ffdad" Nov 04 07:37:00.759981 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:37:00.759961 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10005c29905a2a84ad1eed6d964e7eb3079d3b31e5ef794b3ea39ca65b3ffdad\": container with ID starting with 10005c29905a2a84ad1eed6d964e7eb3079d3b31e5ef794b3ea39ca65b3ffdad not found: ID does not exist" containerID="10005c29905a2a84ad1eed6d964e7eb3079d3b31e5ef794b3ea39ca65b3ffdad" Nov 04 07:37:00.760068 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:00.759994 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10005c29905a2a84ad1eed6d964e7eb3079d3b31e5ef794b3ea39ca65b3ffdad"} err="failed to get container status \"10005c29905a2a84ad1eed6d964e7eb3079d3b31e5ef794b3ea39ca65b3ffdad\": rpc error: code = NotFound desc = could not find container \"10005c29905a2a84ad1eed6d964e7eb3079d3b31e5ef794b3ea39ca65b3ffdad\": container with ID starting with 10005c29905a2a84ad1eed6d964e7eb3079d3b31e5ef794b3ea39ca65b3ffdad not found: ID does not exist" Nov 04 07:37:00.773781 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:00.773730 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" podStartSLOduration=1.7737152520000001 podStartE2EDuration="1.773715252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:36:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:37:00.772266227 +0000 UTC m=+1294.754894420" watchObservedRunningTime="2026-11-04 07:37:00.773715252 +0000 UTC m=+1294.756343447" Nov 04 07:37:00.842691 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:00.842421 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:37:01.552676 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:01.552643 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:37:01.554445 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:01.554418 5030 patch_prober.go:29] interesting pod/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 04 07:37:01.554528 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:01.554480 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" podUID="b5aae1be-49b8-40dc-8caf-45420865f70b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 04 07:37:01.746760 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:01.745989 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:37:01.758454 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:01.758303 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:37:01.759359 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:01.759336 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:37:01.762872 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:01.762788 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:37:01.774417 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:01.774394 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:37:02.552833 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:02.552791 5030 patch_prober.go:29] interesting pod/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 04 07:37:02.553029 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:02.552859 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" podUID="b5aae1be-49b8-40dc-8caf-45420865f70b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 04 07:37:03.552975 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:03.552940 5030 patch_prober.go:29] interesting pod/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 04 07:37:03.553481 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:03.553072 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" podUID="b5aae1be-49b8-40dc-8caf-45420865f70b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 04 07:37:04.553165 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:04.553097 5030 patch_prober.go:29] interesting pod/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 04 07:37:04.553667 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:04.553187 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" podUID="b5aae1be-49b8-40dc-8caf-45420865f70b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 04 07:37:05.552677 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:05.552644 5030 patch_prober.go:29] interesting pod/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 04 07:37:05.552899 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:05.552877 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" podUID="b5aae1be-49b8-40dc-8caf-45420865f70b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 04 07:37:06.552286 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:06.552254 5030 patch_prober.go:29] interesting pod/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 04 07:37:06.552777 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:06.552307 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" podUID="b5aae1be-49b8-40dc-8caf-45420865f70b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 04 07:37:07.557167 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:07.557057 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:37:07.557758 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:07.557735 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:37:07.558556 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:07.558532 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:37:16.373117 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.373086 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz"] Nov 04 07:37:16.377023 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.376998 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.387365 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.387341 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-df3be8-openshift-default-dockercfg-xkvb9\"" Nov 04 07:37:16.391032 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.391008 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz"] Nov 04 07:37:16.551673 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.551634 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-workload-socket\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.551673 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.551672 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-token\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.551879 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.551693 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be3e307f-5c30-440f-80d2-27e34f2f42b4-istiod-ca-cert\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.551879 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.551760 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-podinfo\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.551955 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.551901 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njgf9\" (UniqueName: \"kubernetes.io/projected/be3e307f-5c30-440f-80d2-27e34f2f42b4-kube-api-access-njgf9\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.551955 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.551939 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-data\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.552050 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.551963 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-envoy\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.552094 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.552070 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-workload-certs\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.552149 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.552108 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-credential-socket\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.653315 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.653224 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njgf9\" (UniqueName: \"kubernetes.io/projected/be3e307f-5c30-440f-80d2-27e34f2f42b4-kube-api-access-njgf9\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.653315 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.653295 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-data\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.653535 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.653329 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-envoy\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.653535 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.653420 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-workload-certs\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.653535 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.653479 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-credential-socket\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.653692 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.653543 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-workload-socket\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.653692 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.653629 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-token\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.653692 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.653659 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be3e307f-5c30-440f-80d2-27e34f2f42b4-istiod-ca-cert\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.653833 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.653741 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-data\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.653925 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.653890 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-workload-certs\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.653986 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.653910 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-workload-socket\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.653986 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.653951 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-credential-socket\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.654077 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.653996 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-podinfo\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.654656 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.654631 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be3e307f-5c30-440f-80d2-27e34f2f42b4-istiod-ca-cert\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.655711 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.655688 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-envoy\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.656454 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.656435 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-podinfo\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.665474 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.665454 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-token\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.665683 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.665661 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njgf9\" (UniqueName: \"kubernetes.io/projected/be3e307f-5c30-440f-80d2-27e34f2f42b4-kube-api-access-njgf9\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.690145 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.690113 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:16.973993 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.973968 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz"] Nov 04 07:37:16.975555 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:37:16.975515 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe3e307f_5c30_440f_80d2_27e34f2f42b4.slice/crio-6301ce17525baf680f4ea37b096d7249e92ec600fa3c628d9c9944bb330e85b0 WatchSource:0}: Error finding container 6301ce17525baf680f4ea37b096d7249e92ec600fa3c628d9c9944bb330e85b0: Status 404 returned error can't find the container with id 6301ce17525baf680f4ea37b096d7249e92ec600fa3c628d9c9944bb330e85b0 Nov 04 07:37:16.977900 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.977866 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:37:16.977990 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.977932 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:37:16.977990 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:16.977963 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:37:17.852787 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:17.852748 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" event={"ID":"be3e307f-5c30-440f-80d2-27e34f2f42b4","Type":"ContainerStarted","Data":"db7ffc72d5545015cb975c830dd8dd490976cdd75782cb1f26e5918356d18993"} Nov 04 07:37:17.853316 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:17.852807 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" event={"ID":"be3e307f-5c30-440f-80d2-27e34f2f42b4","Type":"ContainerStarted","Data":"6301ce17525baf680f4ea37b096d7249e92ec600fa3c628d9c9944bb330e85b0"} Nov 04 07:37:18.691196 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:18.691164 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:18.692408 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:18.692382 5030 patch_prober.go:29] interesting pod/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Nov 04 07:37:18.692515 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:18.692429 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" podUID="be3e307f-5c30-440f-80d2-27e34f2f42b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Nov 04 07:37:19.691345 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:19.691307 5030 patch_prober.go:29] interesting pod/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Nov 04 07:37:19.691835 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:19.691365 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" podUID="be3e307f-5c30-440f-80d2-27e34f2f42b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Nov 04 07:37:20.341206 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:20.341125 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" podStartSLOduration=4.34110385 podStartE2EDuration="4.34110385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:37:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:37:17.881436481 +0000 UTC m=+1311.864064674" watchObservedRunningTime="2026-11-04 07:37:20.34110385 +0000 UTC m=+1314.323732044" Nov 04 07:37:20.343892 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:20.343865 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:37:20.691027 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:20.690990 5030 patch_prober.go:29] interesting pod/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Nov 04 07:37:20.691222 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:20.691044 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" podUID="be3e307f-5c30-440f-80d2-27e34f2f42b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Nov 04 07:37:21.690841 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:21.690800 5030 patch_prober.go:29] interesting pod/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Nov 04 07:37:21.691263 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:21.690860 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" podUID="be3e307f-5c30-440f-80d2-27e34f2f42b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Nov 04 07:37:22.348158 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:37:22.347743 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:37:22.690624 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:22.690584 5030 patch_prober.go:29] interesting pod/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Nov 04 07:37:22.690914 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:22.690885 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" podUID="be3e307f-5c30-440f-80d2-27e34f2f42b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Nov 04 07:37:23.705742 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:23.705281 5030 patch_prober.go:29] interesting pod/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Nov 04 07:37:23.705742 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:23.705338 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" podUID="be3e307f-5c30-440f-80d2-27e34f2f42b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Nov 04 07:37:23.843176 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:23.843124 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x"] Nov 04 07:37:23.882363 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:23.882331 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x"] Nov 04 07:37:23.882659 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:23.882643 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:23.900932 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:23.899716 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-extmod-b-812032-openshift-default-dockercfg-2vdn8\"" Nov 04 07:37:23.923248 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:23.923203 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-token\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:23.923500 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:23.923478 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-podinfo\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:23.923745 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:23.923729 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-data\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:23.923883 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:23.923868 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-workload-socket\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:23.923999 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:23.923982 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-credential-socket\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:23.924144 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:23.924115 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q9sg\" (UniqueName: \"kubernetes.io/projected/83eac9c0-e44d-49c0-9448-f0034ee0b10f-kube-api-access-8q9sg\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:23.924268 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:23.924254 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-workload-certs\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:23.924406 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:23.924391 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istiod-ca-cert\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:23.924532 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:23.924515 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-envoy\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:24.050274 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.041168 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-data\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:24.052121 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.052093 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-workload-socket\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:24.052351 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.052330 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-credential-socket\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:24.052484 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.052467 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q9sg\" (UniqueName: \"kubernetes.io/projected/83eac9c0-e44d-49c0-9448-f0034ee0b10f-kube-api-access-8q9sg\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:24.052622 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.052605 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-workload-certs\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:24.052789 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.052770 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istiod-ca-cert\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:24.052916 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.052900 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-envoy\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:24.053054 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.053038 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-token\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:24.053326 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.053306 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-podinfo\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:24.059469 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.051699 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-data\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:24.073162 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.063461 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-workload-socket\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:24.073313 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.070474 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-workload-certs\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:24.073420 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.071078 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istiod-ca-cert\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:24.073498 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.071618 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-credential-socket\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:24.108500 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.108466 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-envoy\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:24.110467 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.109624 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-podinfo\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:24.151561 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.136428 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-token\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:24.184015 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.183948 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q9sg\" (UniqueName: \"kubernetes.io/projected/83eac9c0-e44d-49c0-9448-f0034ee0b10f-kube-api-access-8q9sg\") pod \"e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:24.228601 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.228330 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:24.597652 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.597619 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x"] Nov 04 07:37:24.599855 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:37:24.599823 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83eac9c0_e44d_49c0_9448_f0034ee0b10f.slice/crio-2d7c8eebc688cd3614049e6037bcc4894ec32c0131fed09d1d0f40b7ff04351e WatchSource:0}: Error finding container 2d7c8eebc688cd3614049e6037bcc4894ec32c0131fed09d1d0f40b7ff04351e: Status 404 returned error can't find the container with id 2d7c8eebc688cd3614049e6037bcc4894ec32c0131fed09d1d0f40b7ff04351e Nov 04 07:37:24.602267 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.602235 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:37:24.602340 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.602297 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:37:24.602340 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.602325 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:37:24.691014 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.690984 5030 patch_prober.go:29] interesting pod/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Nov 04 07:37:24.691164 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:24.691072 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" podUID="be3e307f-5c30-440f-80d2-27e34f2f42b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Nov 04 07:37:25.237382 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:25.237344 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" event={"ID":"83eac9c0-e44d-49c0-9448-f0034ee0b10f","Type":"ContainerStarted","Data":"18c4dbde2d545bdbd2486c195423448c104718ef4345833fcf4b830597d0ef83"} Nov 04 07:37:25.237976 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:25.237947 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" event={"ID":"83eac9c0-e44d-49c0-9448-f0034ee0b10f","Type":"ContainerStarted","Data":"2d7c8eebc688cd3614049e6037bcc4894ec32c0131fed09d1d0f40b7ff04351e"} Nov 04 07:37:25.277310 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:25.277252 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" podStartSLOduration=2.277234562 podStartE2EDuration="2.277234562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:37:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:37:25.265198665 +0000 UTC m=+1319.247826868" watchObservedRunningTime="2026-11-04 07:37:25.277234562 +0000 UTC m=+1319.259862755" Nov 04 07:37:26.238229 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:26.238177 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:26.253388 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:26.253336 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:26.262888 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:26.262606 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:26.263701 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:26.263677 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:37:26.736156 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:26.735239 5030 patch_prober.go:29] interesting pod/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 04 07:37:26.736156 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:26.735309 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" podUID="be3e307f-5c30-440f-80d2-27e34f2f42b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 04 07:37:27.310907 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:27.310879 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:27.311534 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:27.311510 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:27.316156 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:27.312213 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:37:29.233733 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.233696 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx"] Nov 04 07:37:29.239227 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.239206 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.261281 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.261247 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-60ed4a-openshift-default-dockercfg-dcrsd\"" Nov 04 07:37:29.270974 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.270940 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx"] Nov 04 07:37:29.396744 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.396707 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-token\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.396928 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.396843 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-workload-certs\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.396928 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.396895 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-podinfo\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.397093 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.397052 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89f8ea73-a637-4f9b-bd7c-bee93b531406-istiod-ca-cert\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.397203 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.397178 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-workload-socket\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.397305 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.397284 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-credential-socket\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.397380 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.397352 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-envoy\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.397485 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.397461 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-data\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.397569 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.397529 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhkhd\" (UniqueName: \"kubernetes.io/projected/89f8ea73-a637-4f9b-bd7c-bee93b531406-kube-api-access-jhkhd\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.498737 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.498648 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhkhd\" (UniqueName: \"kubernetes.io/projected/89f8ea73-a637-4f9b-bd7c-bee93b531406-kube-api-access-jhkhd\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.498737 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.498706 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-token\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.498929 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.498744 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-workload-certs\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.498929 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.498773 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-podinfo\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.499020 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.498952 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89f8ea73-a637-4f9b-bd7c-bee93b531406-istiod-ca-cert\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.499020 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.498975 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-workload-socket\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.499020 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.499015 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-credential-socket\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.499271 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.499173 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-envoy\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.499271 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.499245 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-workload-certs\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.499374 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.499281 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-data\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.499374 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.499342 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-credential-socket\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.499483 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.499458 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-workload-socket\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.499644 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.499623 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-data\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.499707 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.499667 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89f8ea73-a637-4f9b-bd7c-bee93b531406-istiod-ca-cert\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.501289 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.501269 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-envoy\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.501413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.501390 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-podinfo\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.518627 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.518599 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhkhd\" (UniqueName: \"kubernetes.io/projected/89f8ea73-a637-4f9b-bd7c-bee93b531406-kube-api-access-jhkhd\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.519035 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.519008 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-token\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.553503 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.553464 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:29.842229 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.842200 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx"] Nov 04 07:37:29.845250 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:37:29.845218 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89f8ea73_a637_4f9b_bd7c_bee93b531406.slice/crio-49bbb81f3949ff21697e8530f8ccc1f1e73c7ca46fed4cf56ce472b126674121 WatchSource:0}: Error finding container 49bbb81f3949ff21697e8530f8ccc1f1e73c7ca46fed4cf56ce472b126674121: Status 404 returned error can't find the container with id 49bbb81f3949ff21697e8530f8ccc1f1e73c7ca46fed4cf56ce472b126674121 Nov 04 07:37:29.848479 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.848447 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:37:29.848599 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.848526 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:37:29.848599 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:29.848558 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:37:30.288572 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:30.288534 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" event={"ID":"89f8ea73-a637-4f9b-bd7c-bee93b531406","Type":"ContainerStarted","Data":"a5845cfa1806ba5508b378140c7427600e55710fc076ed0d8d7182fe2232d167"} Nov 04 07:37:30.289040 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:30.288614 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" event={"ID":"89f8ea73-a637-4f9b-bd7c-bee93b531406","Type":"ContainerStarted","Data":"49bbb81f3949ff21697e8530f8ccc1f1e73c7ca46fed4cf56ce472b126674121"} Nov 04 07:37:30.322333 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:30.322258 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" podStartSLOduration=1.322237085 podStartE2EDuration="1.322237085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:37:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:37:30.316622299 +0000 UTC m=+1324.299250514" watchObservedRunningTime="2026-11-04 07:37:30.322237085 +0000 UTC m=+1324.304865330" Nov 04 07:37:30.553835 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:30.553759 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:30.555391 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:30.555364 5030 patch_prober.go:29] interesting pod/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Nov 04 07:37:30.555488 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:30.555416 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" podUID="89f8ea73-a637-4f9b-bd7c-bee93b531406" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Nov 04 07:37:31.554072 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:31.554031 5030 patch_prober.go:29] interesting pod/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Nov 04 07:37:31.554580 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:31.554101 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" podUID="89f8ea73-a637-4f9b-bd7c-bee93b531406" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Nov 04 07:37:31.759627 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:31.759542 5030 patch_prober.go:29] interesting pod/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 04 07:37:31.759627 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:31.759604 5030 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" podUID="5eb6bbdd-461f-448e-8dee-3e54fd978d09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 04 07:37:32.301800 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:32.301765 5030 generic.go:356] "Generic (PLEG): container finished" podID="5eb6bbdd-461f-448e-8dee-3e54fd978d09" containerID="38fc708ad0db4ff640841377205d916f33ac04fc8772d91b6c1618fd13d26a44" exitCode=0 Nov 04 07:37:32.301983 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:32.301849 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" event={"ID":"5eb6bbdd-461f-448e-8dee-3e54fd978d09","Type":"ContainerDied","Data":"38fc708ad0db4ff640841377205d916f33ac04fc8772d91b6c1618fd13d26a44"} Nov 04 07:37:32.302323 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:32.302302 5030 scope.go:122] "RemoveContainer" containerID="38fc708ad0db4ff640841377205d916f33ac04fc8772d91b6c1618fd13d26a44" Nov 04 07:37:32.303888 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:32.303863 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:37:32.303965 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:32.303924 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:37:32.303965 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:32.303956 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:37:32.558682 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:32.558570 5030 patch_prober.go:29] interesting pod/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Nov 04 07:37:32.558682 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:32.558636 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" podUID="89f8ea73-a637-4f9b-bd7c-bee93b531406" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Nov 04 07:37:33.309818 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:33.309773 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" event={"ID":"5eb6bbdd-461f-448e-8dee-3e54fd978d09","Type":"ContainerStarted","Data":"b36dcded00bbb14869cfb47cf37a1650c4c17aa5a63bc728e557d0c8b8ce6ce5"} Nov 04 07:37:33.554759 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:33.554724 5030 patch_prober.go:29] interesting pod/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Nov 04 07:37:33.555045 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:33.555004 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" podUID="89f8ea73-a637-4f9b-bd7c-bee93b531406" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Nov 04 07:37:33.572068 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:33.571976 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc"] Nov 04 07:37:33.580172 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:33.580015 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc"] Nov 04 07:37:33.580172 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:33.580169 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc" Nov 04 07:37:33.586301 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:33.586184 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-extmod-b-812032-serving-cert\"" Nov 04 07:37:33.591059 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:33.591033 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/416ca8a7-627c-428f-89fd-a7a55b7a8709-metrics-certs\") pod \"maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc\" (UID: \"416ca8a7-627c-428f-89fd-a7a55b7a8709\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc" Nov 04 07:37:33.591402 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:33.591354 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lglp\" (UniqueName: \"kubernetes.io/projected/416ca8a7-627c-428f-89fd-a7a55b7a8709-kube-api-access-9lglp\") pod \"maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc\" (UID: \"416ca8a7-627c-428f-89fd-a7a55b7a8709\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc" Nov 04 07:37:33.591700 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:33.591680 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/416ca8a7-627c-428f-89fd-a7a55b7a8709-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc\" (UID: \"416ca8a7-627c-428f-89fd-a7a55b7a8709\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc" Nov 04 07:37:33.592161 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:33.592086 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/416ca8a7-627c-428f-89fd-a7a55b7a8709-maas-api-tls\") pod \"maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc\" (UID: \"416ca8a7-627c-428f-89fd-a7a55b7a8709\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc" Nov 04 07:37:33.708162 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:33.693944 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/416ca8a7-627c-428f-89fd-a7a55b7a8709-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc\" (UID: \"416ca8a7-627c-428f-89fd-a7a55b7a8709\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc" Nov 04 07:37:33.708162 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:33.694106 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/416ca8a7-627c-428f-89fd-a7a55b7a8709-maas-api-tls\") pod \"maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc\" (UID: \"416ca8a7-627c-428f-89fd-a7a55b7a8709\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc" Nov 04 07:37:33.708162 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:33.694183 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/416ca8a7-627c-428f-89fd-a7a55b7a8709-metrics-certs\") pod \"maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc\" (UID: \"416ca8a7-627c-428f-89fd-a7a55b7a8709\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc" Nov 04 07:37:33.708162 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:33.694233 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lglp\" (UniqueName: \"kubernetes.io/projected/416ca8a7-627c-428f-89fd-a7a55b7a8709-kube-api-access-9lglp\") pod \"maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc\" (UID: \"416ca8a7-627c-428f-89fd-a7a55b7a8709\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc" Nov 04 07:37:33.708162 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:33.706933 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/416ca8a7-627c-428f-89fd-a7a55b7a8709-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc\" (UID: \"416ca8a7-627c-428f-89fd-a7a55b7a8709\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc" Nov 04 07:37:33.724160 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:33.721913 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/416ca8a7-627c-428f-89fd-a7a55b7a8709-maas-api-tls\") pod \"maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc\" (UID: \"416ca8a7-627c-428f-89fd-a7a55b7a8709\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc" Nov 04 07:37:33.743157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:33.727287 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/416ca8a7-627c-428f-89fd-a7a55b7a8709-metrics-certs\") pod \"maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc\" (UID: \"416ca8a7-627c-428f-89fd-a7a55b7a8709\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc" Nov 04 07:37:33.761156 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:33.751864 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lglp\" (UniqueName: \"kubernetes.io/projected/416ca8a7-627c-428f-89fd-a7a55b7a8709-kube-api-access-9lglp\") pod \"maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc\" (UID: \"416ca8a7-627c-428f-89fd-a7a55b7a8709\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc" Nov 04 07:37:33.834207 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:33.833567 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:37:33.834207 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:33.833717 5030 patch_prober.go:29] interesting pod/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 04 07:37:33.834207 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:33.833773 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" podUID="5eb6bbdd-461f-448e-8dee-3e54fd978d09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 04 07:37:33.900820 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:33.900786 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc" Nov 04 07:37:34.448597 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:34.448511 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc"] Nov 04 07:37:34.576086 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:37:34.574709 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod416ca8a7_627c_428f_89fd_a7a55b7a8709.slice/crio-a8cf2e1cc608501e5b94f263133326b3537b8433619099087efee5392d523f8b WatchSource:0}: Error finding container a8cf2e1cc608501e5b94f263133326b3537b8433619099087efee5392d523f8b: Status 404 returned error can't find the container with id a8cf2e1cc608501e5b94f263133326b3537b8433619099087efee5392d523f8b Nov 04 07:37:34.576086 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:34.575114 5030 patch_prober.go:29] interesting pod/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Nov 04 07:37:34.576086 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:34.575197 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" podUID="89f8ea73-a637-4f9b-bd7c-bee93b531406" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Nov 04 07:37:34.824210 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:34.823475 5030 patch_prober.go:29] interesting pod/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 04 07:37:34.824210 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:34.823536 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" podUID="5eb6bbdd-461f-448e-8dee-3e54fd978d09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 04 07:37:35.518730 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:35.518699 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc" event={"ID":"416ca8a7-627c-428f-89fd-a7a55b7a8709","Type":"ContainerStarted","Data":"a8cf2e1cc608501e5b94f263133326b3537b8433619099087efee5392d523f8b"} Nov 04 07:37:35.564902 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:35.564868 5030 patch_prober.go:29] interesting pod/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Nov 04 07:37:35.599407 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:35.595653 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" podUID="89f8ea73-a637-4f9b-bd7c-bee93b531406" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Nov 04 07:37:35.824330 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:35.824301 5030 patch_prober.go:29] interesting pod/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 04 07:37:35.824535 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:35.824509 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" podUID="5eb6bbdd-461f-448e-8dee-3e54fd978d09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 04 07:37:36.542155 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:36.541247 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc" event={"ID":"416ca8a7-627c-428f-89fd-a7a55b7a8709","Type":"ContainerStarted","Data":"7def7d31e864c449903558ee37dfa5c347e183c91fec46b4bb264ecacf7a8c5c"} Nov 04 07:37:36.542359 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:36.542216 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc" Nov 04 07:37:36.557468 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:36.557439 5030 patch_prober.go:29] interesting pod/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Nov 04 07:37:36.557689 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:36.557666 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" podUID="89f8ea73-a637-4f9b-bd7c-bee93b531406" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Nov 04 07:37:36.824207 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:36.823543 5030 patch_prober.go:29] interesting pod/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 04 07:37:36.824207 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:36.823597 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" podUID="5eb6bbdd-461f-448e-8dee-3e54fd978d09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 04 07:37:37.682276 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:37.682242 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:37.683586 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:37.683443 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:37.688791 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:37.688338 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:37:37.729193 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:37.728053 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc" podStartSLOduration=3.740592195 podStartE2EDuration="4.728033599s" totalImagesPullingTime="987.441404ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:37:36.568659437 +0000 UTC m=+1330.551287629" watchObservedRunningTime="2026-11-04 07:37:37.728033599 +0000 UTC m=+1331.710661792" Nov 04 07:37:37.822960 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:37.822503 5030 patch_prober.go:29] interesting pod/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 04 07:37:37.822960 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:37.822564 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" podUID="5eb6bbdd-461f-448e-8dee-3e54fd978d09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 04 07:37:38.828155 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:38.825624 5030 patch_prober.go:29] interesting pod/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 04 07:37:38.828155 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:38.825689 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" podUID="5eb6bbdd-461f-448e-8dee-3e54fd978d09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 04 07:37:39.838156 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:39.837957 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:37:39.846016 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:39.838928 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:37:39.846016 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:39.843349 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:37:43.576680 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:43.576649 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc" Nov 04 07:37:44.347051 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.347021 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v"] Nov 04 07:37:44.350774 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.350753 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.366996 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.366971 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v"] Nov 04 07:37:44.370288 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.370266 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9"] Nov 04 07:37:44.376164 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.374339 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.390608 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.390584 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9"] Nov 04 07:37:44.426254 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.426224 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-token\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.426378 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.426289 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-workload-certs\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.426424 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.426392 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-envoy\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.426464 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.426446 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww9j7\" (UniqueName: \"kubernetes.io/projected/7d486c29-06b1-4b0a-be57-d79b189ff66d-kube-api-access-ww9j7\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.426498 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.426480 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-credential-socket\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.426531 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.426515 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-data\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.426564 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.426551 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-workload-socket\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.426600 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.426581 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdtmp\" (UniqueName: \"kubernetes.io/projected/795301b3-859d-4a1f-a960-e2dabf9ef43d-kube-api-access-cdtmp\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.426658 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.426636 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-workload-certs\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.426693 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.426665 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/795301b3-859d-4a1f-a960-e2dabf9ef43d-istiod-ca-cert\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.426729 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.426700 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-envoy\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.426763 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.426731 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-data\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.426799 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.426758 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-podinfo\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.426831 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.426797 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-workload-socket\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.426864 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.426839 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-podinfo\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.426906 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.426891 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-token\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.426976 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.426927 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-credential-socket\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.426976 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.426959 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d486c29-06b1-4b0a-be57-d79b189ff66d-istiod-ca-cert\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.527777 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.527749 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-workload-certs\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.527933 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.527794 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-envoy\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.528007 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.527950 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww9j7\" (UniqueName: \"kubernetes.io/projected/7d486c29-06b1-4b0a-be57-d79b189ff66d-kube-api-access-ww9j7\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.528067 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.528000 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-credential-socket\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.528171 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.528057 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-data\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.528304 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.528272 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-workload-certs\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.528304 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.528287 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-workload-socket\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.528485 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.528337 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdtmp\" (UniqueName: \"kubernetes.io/projected/795301b3-859d-4a1f-a960-e2dabf9ef43d-kube-api-access-cdtmp\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.528485 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.528387 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-credential-socket\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.528485 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.528398 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-workload-certs\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.528485 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.528433 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/795301b3-859d-4a1f-a960-e2dabf9ef43d-istiod-ca-cert\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.528485 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.528467 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-envoy\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.528743 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.528499 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-data\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.528743 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.528527 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-podinfo\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.528743 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.528543 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-workload-socket\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.528743 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.528568 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-workload-socket\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.528743 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.528618 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-data\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.528743 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.528633 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-workload-certs\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.528743 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.528735 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-podinfo\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.529082 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.528792 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-token\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.529082 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.528828 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-credential-socket\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.529082 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.528860 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d486c29-06b1-4b0a-be57-d79b189ff66d-istiod-ca-cert\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.529082 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.528898 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-token\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.529341 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.529091 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-workload-socket\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.529341 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.529288 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/795301b3-859d-4a1f-a960-e2dabf9ef43d-istiod-ca-cert\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.529341 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.529327 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-data\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.529726 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.529685 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-credential-socket\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.529849 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.529822 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d486c29-06b1-4b0a-be57-d79b189ff66d-istiod-ca-cert\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.530602 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.530579 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-envoy\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.531945 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.531921 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-envoy\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.532218 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.532193 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-podinfo\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.532348 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.532332 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-podinfo\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.540356 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.540325 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww9j7\" (UniqueName: \"kubernetes.io/projected/7d486c29-06b1-4b0a-be57-d79b189ff66d-kube-api-access-ww9j7\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.540733 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.540710 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdtmp\" (UniqueName: \"kubernetes.io/projected/795301b3-859d-4a1f-a960-e2dabf9ef43d-kube-api-access-cdtmp\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.540883 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.540858 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-token\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.541325 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.541303 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-token\") pod \"e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.666606 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.666580 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:44.690029 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.690003 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:44.953456 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.953412 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v"] Nov 04 07:37:44.953573 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:37:44.953495 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d486c29_06b1_4b0a_be57_d79b189ff66d.slice/crio-7a342622ebcaa46f6dcdfe379476bca3415c566f1c36d3d8e4775ccb10f04a0f WatchSource:0}: Error finding container 7a342622ebcaa46f6dcdfe379476bca3415c566f1c36d3d8e4775ccb10f04a0f: Status 404 returned error can't find the container with id 7a342622ebcaa46f6dcdfe379476bca3415c566f1c36d3d8e4775ccb10f04a0f Nov 04 07:37:44.956513 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.956480 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:37:44.956630 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.956554 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:37:44.956630 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.956597 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:37:44.991503 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.991479 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9"] Nov 04 07:37:44.992359 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:37:44.992332 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod795301b3_859d_4a1f_a960_e2dabf9ef43d.slice/crio-559c8cca2423c0658099c0c86aeb1756a34abc78345bef10afee5d19d91f037b WatchSource:0}: Error finding container 559c8cca2423c0658099c0c86aeb1756a34abc78345bef10afee5d19d91f037b: Status 404 returned error can't find the container with id 559c8cca2423c0658099c0c86aeb1756a34abc78345bef10afee5d19d91f037b Nov 04 07:37:44.994678 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.994647 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:37:44.994766 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.994709 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:37:44.994766 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:44.994738 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:37:45.622338 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:45.622300 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" event={"ID":"7d486c29-06b1-4b0a-be57-d79b189ff66d","Type":"ContainerStarted","Data":"e1f6a2377c368a93d407ae594468d3b5390fb91ed9c6ba01093314932f5cd60e"} Nov 04 07:37:45.622516 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:45.622357 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" event={"ID":"7d486c29-06b1-4b0a-be57-d79b189ff66d","Type":"ContainerStarted","Data":"7a342622ebcaa46f6dcdfe379476bca3415c566f1c36d3d8e4775ccb10f04a0f"} Nov 04 07:37:45.624917 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:45.624888 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" event={"ID":"795301b3-859d-4a1f-a960-e2dabf9ef43d","Type":"ContainerStarted","Data":"93d62d79b5598a8d03e0bb42ee02cd93f343052300958b3e2818efa5eda12b05"} Nov 04 07:37:45.625025 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:45.624953 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" event={"ID":"795301b3-859d-4a1f-a960-e2dabf9ef43d","Type":"ContainerStarted","Data":"559c8cca2423c0658099c0c86aeb1756a34abc78345bef10afee5d19d91f037b"} Nov 04 07:37:45.648432 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:45.648387 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" podStartSLOduration=1.648372653 podStartE2EDuration="1.648372653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:37:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:37:45.645912664 +0000 UTC m=+1339.628540856" watchObservedRunningTime="2026-11-04 07:37:45.648372653 +0000 UTC m=+1339.631000846" Nov 04 07:37:45.667608 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:45.667459 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:45.671307 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:45.671244 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" podStartSLOduration=1.671226475 podStartE2EDuration="1.671226475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:37:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:37:45.671227942 +0000 UTC m=+1339.653856138" watchObservedRunningTime="2026-11-04 07:37:45.671226475 +0000 UTC m=+1339.653854672" Nov 04 07:37:45.693170 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:45.690806 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:46.695169 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:46.694173 5030 patch_prober.go:29] interesting pod/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Nov 04 07:37:46.695169 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:46.694236 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" podUID="795301b3-859d-4a1f-a960-e2dabf9ef43d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Nov 04 07:37:46.698530 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:46.698497 5030 patch_prober.go:29] interesting pod/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Nov 04 07:37:46.698654 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:46.698549 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" podUID="7d486c29-06b1-4b0a-be57-d79b189ff66d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Nov 04 07:37:47.559882 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:47.559818 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5"] Nov 04 07:37:47.597148 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:47.597102 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5"] Nov 04 07:37:47.597423 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:47.597245 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5" Nov 04 07:37:47.604612 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:47.604587 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-extmod-a-2a8c48-serving-cert\"" Nov 04 07:37:47.671627 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:47.671592 5030 patch_prober.go:29] interesting pod/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Nov 04 07:37:47.671893 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:47.671866 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" podUID="7d486c29-06b1-4b0a-be57-d79b189ff66d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Nov 04 07:37:47.690333 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:47.690306 5030 patch_prober.go:29] interesting pod/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Nov 04 07:37:47.690490 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:47.690343 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" podUID="795301b3-859d-4a1f-a960-e2dabf9ef43d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Nov 04 07:37:47.708157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:47.708107 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/618777a4-9d04-40dc-abd7-6754b8e1c785-metrics-certs\") pod \"maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5\" (UID: \"618777a4-9d04-40dc-abd7-6754b8e1c785\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5" Nov 04 07:37:47.708490 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:47.708186 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2njc\" (UniqueName: \"kubernetes.io/projected/618777a4-9d04-40dc-abd7-6754b8e1c785-kube-api-access-c2njc\") pod \"maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5\" (UID: \"618777a4-9d04-40dc-abd7-6754b8e1c785\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5" Nov 04 07:37:47.708490 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:47.708247 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/618777a4-9d04-40dc-abd7-6754b8e1c785-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5\" (UID: \"618777a4-9d04-40dc-abd7-6754b8e1c785\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5" Nov 04 07:37:47.708490 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:47.708269 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/618777a4-9d04-40dc-abd7-6754b8e1c785-maas-api-tls\") pod \"maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5\" (UID: \"618777a4-9d04-40dc-abd7-6754b8e1c785\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5" Nov 04 07:37:47.809505 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:47.809470 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2njc\" (UniqueName: \"kubernetes.io/projected/618777a4-9d04-40dc-abd7-6754b8e1c785-kube-api-access-c2njc\") pod \"maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5\" (UID: \"618777a4-9d04-40dc-abd7-6754b8e1c785\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5" Nov 04 07:37:47.810454 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:47.810408 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/618777a4-9d04-40dc-abd7-6754b8e1c785-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5\" (UID: \"618777a4-9d04-40dc-abd7-6754b8e1c785\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5" Nov 04 07:37:47.810567 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:47.810552 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/618777a4-9d04-40dc-abd7-6754b8e1c785-maas-api-tls\") pod \"maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5\" (UID: \"618777a4-9d04-40dc-abd7-6754b8e1c785\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5" Nov 04 07:37:47.811820 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:47.810892 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/618777a4-9d04-40dc-abd7-6754b8e1c785-metrics-certs\") pod \"maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5\" (UID: \"618777a4-9d04-40dc-abd7-6754b8e1c785\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5" Nov 04 07:37:47.812005 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:47.811851 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/618777a4-9d04-40dc-abd7-6754b8e1c785-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5\" (UID: \"618777a4-9d04-40dc-abd7-6754b8e1c785\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5" Nov 04 07:37:47.843203 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:47.843178 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/618777a4-9d04-40dc-abd7-6754b8e1c785-metrics-certs\") pod \"maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5\" (UID: \"618777a4-9d04-40dc-abd7-6754b8e1c785\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5" Nov 04 07:37:47.848026 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:47.847974 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/618777a4-9d04-40dc-abd7-6754b8e1c785-maas-api-tls\") pod \"maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5\" (UID: \"618777a4-9d04-40dc-abd7-6754b8e1c785\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5" Nov 04 07:37:47.862185 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:47.854765 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2njc\" (UniqueName: \"kubernetes.io/projected/618777a4-9d04-40dc-abd7-6754b8e1c785-kube-api-access-c2njc\") pod \"maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5\" (UID: \"618777a4-9d04-40dc-abd7-6754b8e1c785\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5" Nov 04 07:37:47.920243 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:47.912268 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5" Nov 04 07:37:48.428825 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:48.428792 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5"] Nov 04 07:37:48.492159 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:37:48.488666 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod618777a4_9d04_40dc_abd7_6754b8e1c785.slice/crio-c1cbafa57b9ce3503c5218b3ae3f003cc76f1bbf13f05a80d124d266332ce636 WatchSource:0}: Error finding container c1cbafa57b9ce3503c5218b3ae3f003cc76f1bbf13f05a80d124d266332ce636: Status 404 returned error can't find the container with id c1cbafa57b9ce3503c5218b3ae3f003cc76f1bbf13f05a80d124d266332ce636 Nov 04 07:37:48.682205 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:48.678267 5030 patch_prober.go:29] interesting pod/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Nov 04 07:37:48.682205 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:48.678338 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" podUID="7d486c29-06b1-4b0a-be57-d79b189ff66d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Nov 04 07:37:48.762927 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:48.758284 5030 patch_prober.go:29] interesting pod/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Nov 04 07:37:48.772189 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:48.770233 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" podUID="795301b3-859d-4a1f-a960-e2dabf9ef43d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Nov 04 07:37:48.927519 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:48.927479 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5" event={"ID":"618777a4-9d04-40dc-abd7-6754b8e1c785","Type":"ContainerStarted","Data":"c1cbafa57b9ce3503c5218b3ae3f003cc76f1bbf13f05a80d124d266332ce636"} Nov 04 07:37:48.936786 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:48.936699 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:37:49.673156 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:49.669542 5030 patch_prober.go:29] interesting pod/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Nov 04 07:37:49.673156 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:49.670100 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" podUID="7d486c29-06b1-4b0a-be57-d79b189ff66d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Nov 04 07:37:49.751160 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:49.750176 5030 patch_prober.go:29] interesting pod/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Nov 04 07:37:49.751160 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:49.750247 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" podUID="795301b3-859d-4a1f-a960-e2dabf9ef43d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Nov 04 07:37:49.962210 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:49.956756 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5" event={"ID":"618777a4-9d04-40dc-abd7-6754b8e1c785","Type":"ContainerStarted","Data":"b9fe50fdc26b046454d9d3dd25ab83d7d49211393f6e21cbd3f0f9d2cd491d19"} Nov 04 07:37:49.966803 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:49.966775 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5" Nov 04 07:37:50.689156 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:50.669579 5030 patch_prober.go:29] interesting pod/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Nov 04 07:37:50.689156 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:50.669661 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" podUID="7d486c29-06b1-4b0a-be57-d79b189ff66d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Nov 04 07:37:50.696489 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:50.694964 5030 patch_prober.go:29] interesting pod/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Nov 04 07:37:50.696489 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:50.695026 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" podUID="795301b3-859d-4a1f-a960-e2dabf9ef43d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Nov 04 07:37:51.667311 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:51.667279 5030 patch_prober.go:29] interesting pod/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Nov 04 07:37:51.667774 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:51.667747 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" podUID="7d486c29-06b1-4b0a-be57-d79b189ff66d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Nov 04 07:37:51.695228 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:51.690512 5030 patch_prober.go:29] interesting pod/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Nov 04 07:37:51.695228 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:51.690564 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" podUID="795301b3-859d-4a1f-a960-e2dabf9ef43d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Nov 04 07:37:52.361801 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:37:52.361744 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:37:52.686841 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:52.686810 5030 patch_prober.go:29] interesting pod/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Nov 04 07:37:52.709500 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:52.709464 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" podUID="7d486c29-06b1-4b0a-be57-d79b189ff66d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Nov 04 07:37:52.720038 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:52.709362 5030 patch_prober.go:29] interesting pod/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Nov 04 07:37:52.720311 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:52.720284 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" podUID="795301b3-859d-4a1f-a960-e2dabf9ef43d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Nov 04 07:37:54.360633 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:54.360597 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:54.362564 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:54.362544 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:54.366786 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:54.366768 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:37:54.396001 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:54.395941 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5" podStartSLOduration=6.810176144 podStartE2EDuration="7.395921859s" totalImagesPullingTime="585.745715ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:37:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:37:50.0013448 +0000 UTC m=+1343.983972992" watchObservedRunningTime="2026-11-04 07:37:54.395921859 +0000 UTC m=+1348.378550052" Nov 04 07:37:54.477230 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:54.475698 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:54.477230 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:54.476586 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:54.590157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:54.569573 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:37:56.995004 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:56.994971 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5" Nov 04 07:37:59.210923 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.210870 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp"] Nov 04 07:37:59.216261 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.216236 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.235304 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.235272 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp"] Nov 04 07:37:59.329676 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.329637 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-envoy\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.329855 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.329683 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-data\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.329855 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.329821 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf999862-2c2c-41ab-a950-a0935b6dec14-istiod-ca-cert\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.329982 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.329930 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-podinfo\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.330038 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.330011 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-workload-socket\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.330100 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.330046 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-455bz\" (UniqueName: \"kubernetes.io/projected/cf999862-2c2c-41ab-a950-a0935b6dec14-kube-api-access-455bz\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.330180 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.330155 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-credential-socket\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.330238 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.330191 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-workload-certs\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.330290 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.330261 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-token\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.431827 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.431790 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf999862-2c2c-41ab-a950-a0935b6dec14-istiod-ca-cert\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.432023 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.431883 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-podinfo\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.432023 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.431973 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-workload-socket\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.432188 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.432022 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-455bz\" (UniqueName: \"kubernetes.io/projected/cf999862-2c2c-41ab-a950-a0935b6dec14-kube-api-access-455bz\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.432188 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.432059 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-credential-socket\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.432188 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.432085 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-workload-certs\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.432188 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.432178 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-token\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.432396 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.432213 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-envoy\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.432396 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.432239 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-data\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.432557 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.432529 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf999862-2c2c-41ab-a950-a0935b6dec14-istiod-ca-cert\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.432682 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.432647 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-data\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.433107 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.433059 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-workload-certs\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.433273 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.433176 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-workload-socket\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.433467 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.433445 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-credential-socket\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.435348 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.435320 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-envoy\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.435475 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.435452 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-podinfo\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.445306 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.445271 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-token\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.448465 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.448439 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-455bz\" (UniqueName: \"kubernetes.io/projected/cf999862-2c2c-41ab-a950-a0935b6dec14-kube-api-access-455bz\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.540289 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.540207 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:37:59.865101 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.865011 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp"] Nov 04 07:37:59.889076 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:37:59.889020 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf999862_2c2c_41ab_a950_a0935b6dec14.slice/crio-d7a0152341f518ecdf0f784eaf4b59e663ecf293091a108fc194311070ee8d56 WatchSource:0}: Error finding container d7a0152341f518ecdf0f784eaf4b59e663ecf293091a108fc194311070ee8d56: Status 404 returned error can't find the container with id d7a0152341f518ecdf0f784eaf4b59e663ecf293091a108fc194311070ee8d56 Nov 04 07:37:59.892287 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.892240 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:37:59.892426 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.892313 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:37:59.892426 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:37:59.892343 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:38:00.192538 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:00.192495 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" event={"ID":"cf999862-2c2c-41ab-a950-a0935b6dec14","Type":"ContainerStarted","Data":"e517d679b4cf6cbff682731c48dc4136b14431100296d17139efc63009e73ec5"} Nov 04 07:38:00.192737 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:00.192561 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" event={"ID":"cf999862-2c2c-41ab-a950-a0935b6dec14","Type":"ContainerStarted","Data":"d7a0152341f518ecdf0f784eaf4b59e663ecf293091a108fc194311070ee8d56"} Nov 04 07:38:00.215298 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:00.213069 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" podStartSLOduration=1.2130461 podStartE2EDuration="1.2130461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:37:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:38:00.211548129 +0000 UTC m=+1354.194176323" watchObservedRunningTime="2026-11-04 07:38:00.2130461 +0000 UTC m=+1354.195674294" Nov 04 07:38:00.541027 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:00.540933 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:38:00.542938 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:00.542906 5030 patch_prober.go:29] interesting pod/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Nov 04 07:38:00.543064 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:00.542973 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" podUID="cf999862-2c2c-41ab-a950-a0935b6dec14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Nov 04 07:38:01.066155 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.066113 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh"] Nov 04 07:38:01.071148 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.071116 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.087952 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.087898 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh"] Nov 04 07:38:01.350209 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.349555 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc99ae93-4fe9-496c-aa62-f393f3590e85-workload-certs\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.350209 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.349673 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc99ae93-4fe9-496c-aa62-f393f3590e85-istio-data\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.350209 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.349785 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc99ae93-4fe9-496c-aa62-f393f3590e85-istio-podinfo\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.353415 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.351053 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bsk8\" (UniqueName: \"kubernetes.io/projected/fc99ae93-4fe9-496c-aa62-f393f3590e85-kube-api-access-7bsk8\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.353415 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.351436 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc99ae93-4fe9-496c-aa62-f393f3590e85-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.353415 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.351754 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc99ae93-4fe9-496c-aa62-f393f3590e85-credential-socket\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.353415 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.352184 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc99ae93-4fe9-496c-aa62-f393f3590e85-workload-socket\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.353415 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.352259 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc99ae93-4fe9-496c-aa62-f393f3590e85-istio-envoy\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.353415 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.352284 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc99ae93-4fe9-496c-aa62-f393f3590e85-istio-token\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.459155 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.454791 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc99ae93-4fe9-496c-aa62-f393f3590e85-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.459155 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.454878 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc99ae93-4fe9-496c-aa62-f393f3590e85-credential-socket\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.459155 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.454923 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc99ae93-4fe9-496c-aa62-f393f3590e85-workload-socket\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.459155 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.454945 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc99ae93-4fe9-496c-aa62-f393f3590e85-istio-envoy\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.459155 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.454970 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc99ae93-4fe9-496c-aa62-f393f3590e85-istio-token\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.459155 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.455031 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc99ae93-4fe9-496c-aa62-f393f3590e85-workload-certs\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.459155 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.455059 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc99ae93-4fe9-496c-aa62-f393f3590e85-istio-data\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.459155 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.455110 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc99ae93-4fe9-496c-aa62-f393f3590e85-istio-podinfo\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.459155 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.455261 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bsk8\" (UniqueName: \"kubernetes.io/projected/fc99ae93-4fe9-496c-aa62-f393f3590e85-kube-api-access-7bsk8\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.459155 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.456478 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc99ae93-4fe9-496c-aa62-f393f3590e85-credential-socket\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.459155 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.456729 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc99ae93-4fe9-496c-aa62-f393f3590e85-workload-socket\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.459155 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.457495 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc99ae93-4fe9-496c-aa62-f393f3590e85-istio-data\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.459155 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.457744 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc99ae93-4fe9-496c-aa62-f393f3590e85-workload-certs\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.459980 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.459831 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc99ae93-4fe9-496c-aa62-f393f3590e85-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.483166 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.482877 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc99ae93-4fe9-496c-aa62-f393f3590e85-istio-token\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.493182 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.483416 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc99ae93-4fe9-496c-aa62-f393f3590e85-istio-envoy\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.493182 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.484023 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bsk8\" (UniqueName: \"kubernetes.io/projected/fc99ae93-4fe9-496c-aa62-f393f3590e85-kube-api-access-7bsk8\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.493182 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.493072 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc99ae93-4fe9-496c-aa62-f393f3590e85-istio-podinfo\") pod \"maas-default-gateway-openshift-default-74854d8ccf-mvvkh\" (UID: \"fc99ae93-4fe9-496c-aa62-f393f3590e85\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:01.543070 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.542592 5030 patch_prober.go:29] interesting pod/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Nov 04 07:38:01.543070 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.542656 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" podUID="cf999862-2c2c-41ab-a950-a0935b6dec14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Nov 04 07:38:01.690159 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:01.689844 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:02.082699 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:02.082661 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh"] Nov 04 07:38:02.084261 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:38:02.084230 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc99ae93_4fe9_496c_aa62_f393f3590e85.slice/crio-8196bcd71bd4a651edc09013a1d638c8d41be489832f5ca6e8fdba4619ea8adc WatchSource:0}: Error finding container 8196bcd71bd4a651edc09013a1d638c8d41be489832f5ca6e8fdba4619ea8adc: Status 404 returned error can't find the container with id 8196bcd71bd4a651edc09013a1d638c8d41be489832f5ca6e8fdba4619ea8adc Nov 04 07:38:02.086788 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:02.086758 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:38:02.086861 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:02.086827 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:38:02.086861 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:02.086856 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:38:02.316157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:02.308166 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" event={"ID":"fc99ae93-4fe9-496c-aa62-f393f3590e85","Type":"ContainerStarted","Data":"e4937cb3c4abad3e59d4c1952ad678e2b50dbf9b1b7c5f7634e342c76fed187a"} Nov 04 07:38:02.316157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:02.308251 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" event={"ID":"fc99ae93-4fe9-496c-aa62-f393f3590e85","Type":"ContainerStarted","Data":"8196bcd71bd4a651edc09013a1d638c8d41be489832f5ca6e8fdba4619ea8adc"} Nov 04 07:38:02.316157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:02.312299 5030 generic.go:356] "Generic (PLEG): container finished" podID="83eac9c0-e44d-49c0-9448-f0034ee0b10f" containerID="18c4dbde2d545bdbd2486c195423448c104718ef4345833fcf4b830597d0ef83" exitCode=0 Nov 04 07:38:02.316157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:02.313067 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" event={"ID":"83eac9c0-e44d-49c0-9448-f0034ee0b10f","Type":"ContainerDied","Data":"18c4dbde2d545bdbd2486c195423448c104718ef4345833fcf4b830597d0ef83"} Nov 04 07:38:02.324765 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:02.323522 5030 scope.go:122] "RemoveContainer" containerID="18c4dbde2d545bdbd2486c195423448c104718ef4345833fcf4b830597d0ef83" Nov 04 07:38:02.331212 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:02.326446 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:38:02.331212 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:02.326531 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:38:02.331212 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:02.326574 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:38:02.373727 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:02.373674 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" podStartSLOduration=1.373654808 podStartE2EDuration="1.373654808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:38:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:38:02.34298619 +0000 UTC m=+1356.325614388" watchObservedRunningTime="2026-11-04 07:38:02.373654808 +0000 UTC m=+1356.356283005" Nov 04 07:38:02.561925 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:02.561480 5030 patch_prober.go:29] interesting pod/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Nov 04 07:38:02.561925 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:02.561543 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" podUID="cf999862-2c2c-41ab-a950-a0935b6dec14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Nov 04 07:38:02.690938 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:02.690905 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:03.360198 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:03.360161 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" event={"ID":"83eac9c0-e44d-49c0-9448-f0034ee0b10f","Type":"ContainerStarted","Data":"123ae6951da6de9b98018d5d2f446d67b94c66cb6d33a559ca5e4798e209d21f"} Nov 04 07:38:03.542633 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:03.542590 5030 patch_prober.go:29] interesting pod/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Nov 04 07:38:03.543246 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:03.543202 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" podUID="cf999862-2c2c-41ab-a950-a0935b6dec14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Nov 04 07:38:03.705158 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:03.702393 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-mvvkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Nov 04 07:38:03.705158 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:03.702451 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" podUID="fc99ae93-4fe9-496c-aa62-f393f3590e85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Nov 04 07:38:04.231033 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:04.230542 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:38:04.231033 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:04.230698 5030 patch_prober.go:29] interesting pod/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Nov 04 07:38:04.231033 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:04.230757 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" podUID="83eac9c0-e44d-49c0-9448-f0034ee0b10f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Nov 04 07:38:04.542320 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:04.542226 5030 patch_prober.go:29] interesting pod/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Nov 04 07:38:04.542597 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:04.542563 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" podUID="cf999862-2c2c-41ab-a950-a0935b6dec14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Nov 04 07:38:04.692680 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:04.692634 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-mvvkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Nov 04 07:38:04.693285 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:04.693255 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" podUID="fc99ae93-4fe9-496c-aa62-f393f3590e85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Nov 04 07:38:05.259213 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:05.259174 5030 patch_prober.go:29] interesting pod/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Nov 04 07:38:05.268536 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:05.268500 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" podUID="83eac9c0-e44d-49c0-9448-f0034ee0b10f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Nov 04 07:38:05.448191 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:05.437029 5030 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" podUID="295a2c1a-9e30-4fd1-a561-ccca72c2cde1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": context deadline exceeded" Nov 04 07:38:05.546026 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:05.545936 5030 patch_prober.go:29] interesting pod/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Nov 04 07:38:05.546318 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:05.546287 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" podUID="cf999862-2c2c-41ab-a950-a0935b6dec14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Nov 04 07:38:05.772257 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:05.772210 5030 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" podUID="0b28a1b0-7560-46f8-b0af-03eb3a196958" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": context deadline exceeded" Nov 04 07:38:05.774931 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:05.774449 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-mvvkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Nov 04 07:38:05.780271 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:05.780240 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" podUID="fc99ae93-4fe9-496c-aa62-f393f3590e85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Nov 04 07:38:06.240851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:06.240816 5030 patch_prober.go:29] interesting pod/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Nov 04 07:38:06.241166 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:06.241095 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" podUID="83eac9c0-e44d-49c0-9448-f0034ee0b10f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Nov 04 07:38:06.465660 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:06.465566 5030 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" podUID="295a2c1a-9e30-4fd1-a561-ccca72c2cde1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 04 07:38:06.475272 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:06.466291 5030 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" podUID="6d707a40-b0a6-4c4d-a001-10536187e51c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": context deadline exceeded" Nov 04 07:38:06.501938 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:06.475803 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:38:06.549175 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:06.547477 5030 patch_prober.go:29] interesting pod/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Nov 04 07:38:06.549175 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:06.547533 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" podUID="cf999862-2c2c-41ab-a950-a0935b6dec14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Nov 04 07:38:06.716509 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:06.706476 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-mvvkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Nov 04 07:38:06.716509 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:06.706533 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" podUID="fc99ae93-4fe9-496c-aa62-f393f3590e85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Nov 04 07:38:06.777880 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:06.777681 5030 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" podUID="0b28a1b0-7560-46f8-b0af-03eb3a196958" containerName="main" probeResult="failure" output="Get \"https://10.132.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 04 07:38:06.800594 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:06.800565 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:38:07.243230 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:07.221945 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:38:07.243230 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:07.229469 5030 patch_prober.go:29] interesting pod/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Nov 04 07:38:07.243230 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:07.229539 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" podUID="83eac9c0-e44d-49c0-9448-f0034ee0b10f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Nov 04 07:38:07.445148 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:07.445101 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:38:07.524393 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:07.524280 5030 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" podUID="6d707a40-b0a6-4c4d-a001-10536187e51c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 04 07:38:07.526332 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:07.526311 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:38:07.542405 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:07.542374 5030 patch_prober.go:29] interesting pod/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Nov 04 07:38:07.542659 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:07.542625 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" podUID="cf999862-2c2c-41ab-a950-a0935b6dec14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Nov 04 07:38:07.703154 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:07.701317 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-mvvkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Nov 04 07:38:07.703154 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:07.701387 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" podUID="fc99ae93-4fe9-496c-aa62-f393f3590e85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Nov 04 07:38:08.222264 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:08.222230 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:38:08.234866 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:08.234837 5030 patch_prober.go:29] interesting pod/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Nov 04 07:38:08.235144 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:08.235101 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" podUID="83eac9c0-e44d-49c0-9448-f0034ee0b10f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Nov 04 07:38:08.549382 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:08.549300 5030 patch_prober.go:29] interesting pod/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Nov 04 07:38:08.549864 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:08.549829 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" podUID="cf999862-2c2c-41ab-a950-a0935b6dec14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Nov 04 07:38:08.691504 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:08.691467 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-mvvkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Nov 04 07:38:08.691765 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:08.691738 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" podUID="fc99ae93-4fe9-496c-aa62-f393f3590e85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Nov 04 07:38:09.247504 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.247469 5030 patch_prober.go:29] interesting pod/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Nov 04 07:38:09.266289 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.266241 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" podUID="83eac9c0-e44d-49c0-9448-f0034ee0b10f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Nov 04 07:38:09.546911 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.545474 5030 patch_prober.go:29] interesting pod/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Nov 04 07:38:09.546911 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.545533 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" podUID="cf999862-2c2c-41ab-a950-a0935b6dec14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Nov 04 07:38:09.650002 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.649962 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245"] Nov 04 07:38:09.677925 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.677899 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:09.734358 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.685747 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Nov 04 07:38:09.734358 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.687896 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-lnsrk\"" Nov 04 07:38:09.734358 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.677797 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245"] Nov 04 07:38:09.734358 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.695511 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-mvvkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Nov 04 07:38:09.734358 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.695555 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" podUID="fc99ae93-4fe9-496c-aa62-f393f3590e85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Nov 04 07:38:09.734358 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.695956 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Nov 04 07:38:09.734358 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.696008 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Nov 04 07:38:09.760851 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.760816 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7736c518-c73d-486b-bd3a-dd38aa8182a3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8j245\" (UID: \"7736c518-c73d-486b-bd3a-dd38aa8182a3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:09.801320 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.801215 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7736c518-c73d-486b-bd3a-dd38aa8182a3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8j245\" (UID: \"7736c518-c73d-486b-bd3a-dd38aa8182a3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:09.801588 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.801565 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7736c518-c73d-486b-bd3a-dd38aa8182a3-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8j245\" (UID: \"7736c518-c73d-486b-bd3a-dd38aa8182a3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:09.809172 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.801764 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7736c518-c73d-486b-bd3a-dd38aa8182a3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8j245\" (UID: \"7736c518-c73d-486b-bd3a-dd38aa8182a3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:09.810258 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.810232 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7736c518-c73d-486b-bd3a-dd38aa8182a3-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8j245\" (UID: \"7736c518-c73d-486b-bd3a-dd38aa8182a3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:09.810435 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.810414 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7736c518-c73d-486b-bd3a-dd38aa8182a3-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8j245\" (UID: \"7736c518-c73d-486b-bd3a-dd38aa8182a3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:09.810524 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.810489 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq7nj\" (UniqueName: \"kubernetes.io/projected/7736c518-c73d-486b-bd3a-dd38aa8182a3-kube-api-access-bq7nj\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8j245\" (UID: \"7736c518-c73d-486b-bd3a-dd38aa8182a3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:09.916158 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.912377 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7736c518-c73d-486b-bd3a-dd38aa8182a3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8j245\" (UID: \"7736c518-c73d-486b-bd3a-dd38aa8182a3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:09.916158 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.912472 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7736c518-c73d-486b-bd3a-dd38aa8182a3-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8j245\" (UID: \"7736c518-c73d-486b-bd3a-dd38aa8182a3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:09.916158 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.912531 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7736c518-c73d-486b-bd3a-dd38aa8182a3-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8j245\" (UID: \"7736c518-c73d-486b-bd3a-dd38aa8182a3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:09.916158 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.912584 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq7nj\" (UniqueName: \"kubernetes.io/projected/7736c518-c73d-486b-bd3a-dd38aa8182a3-kube-api-access-bq7nj\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8j245\" (UID: \"7736c518-c73d-486b-bd3a-dd38aa8182a3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:09.916158 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.912641 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7736c518-c73d-486b-bd3a-dd38aa8182a3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8j245\" (UID: \"7736c518-c73d-486b-bd3a-dd38aa8182a3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:09.916158 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.912670 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7736c518-c73d-486b-bd3a-dd38aa8182a3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8j245\" (UID: \"7736c518-c73d-486b-bd3a-dd38aa8182a3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:09.916158 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.912725 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7736c518-c73d-486b-bd3a-dd38aa8182a3-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8j245\" (UID: \"7736c518-c73d-486b-bd3a-dd38aa8182a3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:09.931970 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.931600 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7736c518-c73d-486b-bd3a-dd38aa8182a3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8j245\" (UID: \"7736c518-c73d-486b-bd3a-dd38aa8182a3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:09.937462 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.937397 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7736c518-c73d-486b-bd3a-dd38aa8182a3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8j245\" (UID: \"7736c518-c73d-486b-bd3a-dd38aa8182a3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:09.952161 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.942538 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7736c518-c73d-486b-bd3a-dd38aa8182a3-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8j245\" (UID: \"7736c518-c73d-486b-bd3a-dd38aa8182a3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:09.952161 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.942540 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7736c518-c73d-486b-bd3a-dd38aa8182a3-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8j245\" (UID: \"7736c518-c73d-486b-bd3a-dd38aa8182a3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:09.953221 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.953197 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7736c518-c73d-486b-bd3a-dd38aa8182a3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8j245\" (UID: \"7736c518-c73d-486b-bd3a-dd38aa8182a3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:09.969780 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.969755 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq7nj\" (UniqueName: \"kubernetes.io/projected/7736c518-c73d-486b-bd3a-dd38aa8182a3-kube-api-access-bq7nj\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8j245\" (UID: \"7736c518-c73d-486b-bd3a-dd38aa8182a3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:09.973180 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:09.970736 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7736c518-c73d-486b-bd3a-dd38aa8182a3-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-8j245\" (UID: \"7736c518-c73d-486b-bd3a-dd38aa8182a3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:10.021315 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:10.021283 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:10.229464 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:10.229425 5030 patch_prober.go:29] interesting pod/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Nov 04 07:38:10.229736 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:10.229703 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" podUID="83eac9c0-e44d-49c0-9448-f0034ee0b10f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Nov 04 07:38:10.728703 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:10.727255 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-mvvkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Nov 04 07:38:10.728703 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:10.727316 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" podUID="fc99ae93-4fe9-496c-aa62-f393f3590e85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Nov 04 07:38:10.955269 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:10.955202 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245"] Nov 04 07:38:11.233157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:11.232426 5030 patch_prober.go:29] interesting pod/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Nov 04 07:38:11.233157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:11.232485 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" podUID="83eac9c0-e44d-49c0-9448-f0034ee0b10f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Nov 04 07:38:11.266273 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:11.265231 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:38:11.553205 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:11.549518 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:38:11.553205 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:11.550968 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:38:11.554366 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:11.554343 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:38:11.690741 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:11.690703 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-mvvkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Nov 04 07:38:11.690930 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:11.690767 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" podUID="fc99ae93-4fe9-496c-aa62-f393f3590e85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Nov 04 07:38:11.788477 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:11.788433 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" event={"ID":"7736c518-c73d-486b-bd3a-dd38aa8182a3","Type":"ContainerStarted","Data":"dde7a7c385b5dee4c4312a43697381726a9ae7e3f951b22ebe718c433462f8a0"} Nov 04 07:38:12.243941 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:12.243537 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:38:12.252846 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:12.252818 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:38:12.691646 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:12.691611 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-mvvkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Nov 04 07:38:12.691855 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:12.691669 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" podUID="fc99ae93-4fe9-496c-aa62-f393f3590e85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Nov 04 07:38:14.733343 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:14.733293 5030 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-74854d8ccf-mvvkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 04 07:38:14.733794 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:14.733359 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" podUID="fc99ae93-4fe9-496c-aa62-f393f3590e85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 04 07:38:14.820666 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:14.820627 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:14.822034 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:14.821972 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:14.822731 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:14.822708 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-74854d8ccf-mvvkh" Nov 04 07:38:15.016402 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:15.016327 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:38:15.016551 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:15.016442 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:38:15.874554 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:15.874522 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" event={"ID":"7736c518-c73d-486b-bd3a-dd38aa8182a3","Type":"ContainerStarted","Data":"db4d1dd9897d646dd4f79165c61345c81f9521608b2915cf63d5a7ea0d15fe49"} Nov 04 07:38:15.875096 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:15.875075 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:15.900575 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:15.900530 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" podStartSLOduration=2.876532168 podStartE2EDuration="6.900517995s" totalImagesPullingTime="4.023985827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:38:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:38:15.897658569 +0000 UTC m=+1369.880286762" watchObservedRunningTime="2026-11-04 07:38:15.900517995 +0000 UTC m=+1369.883146187" Nov 04 07:38:16.882551 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:16.882522 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-8j245" Nov 04 07:38:22.141304 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:38:22.141266 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:38:25.029117 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:25.029081 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:38:50.602687 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:50.602592 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8"] Nov 04 07:38:52.141289 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:38:52.141227 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:38:58.245820 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:38:58.245783 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:39:05.624049 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:05.624011 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" podUID="295a2c1a-9e30-4fd1-a561-ccca72c2cde1" containerName="main" containerID="cri-o://253fb9645bcbd6edbbb81c2b1f12a1befba44a1aef3849509e53ae4554db1fb0" gracePeriod=45 Nov 04 07:39:05.909694 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:05.909667 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:39:05.942264 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:05.942232 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-dshm\" (UniqueName: \"kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-dshm\") pod \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\" (UID: \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\") " Nov 04 07:39:05.942413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:05.942303 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-tls-certs\" (UniqueName: \"kubernetes.io/secret/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-tls-certs\") pod \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\" (UID: \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\") " Nov 04 07:39:05.942413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:05.942369 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-model-cache\") pod \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\" (UID: \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\") " Nov 04 07:39:05.942535 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:05.942436 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-home\" (UniqueName: \"kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-home\") pod \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\" (UID: \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\") " Nov 04 07:39:05.942535 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:05.942490 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-tmp-dir\") pod \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\" (UID: \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\") " Nov 04 07:39:05.942637 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:05.942590 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-kube-api-access-5m7pl\" (UniqueName: \"kubernetes.io/projected/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-kube-api-access-5m7pl\") pod \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\" (UID: \"295a2c1a-9e30-4fd1-a561-ccca72c2cde1\") " Nov 04 07:39:05.942713 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:05.942666 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-model-cache" pod "295a2c1a-9e30-4fd1-a561-ccca72c2cde1" (UID: "295a2c1a-9e30-4fd1-a561-ccca72c2cde1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:39:05.942773 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:05.942740 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-home" pod "295a2c1a-9e30-4fd1-a561-ccca72c2cde1" (UID: "295a2c1a-9e30-4fd1-a561-ccca72c2cde1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:39:05.942893 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:05.942871 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-tmp-dir" pod "295a2c1a-9e30-4fd1-a561-ccca72c2cde1" (UID: "295a2c1a-9e30-4fd1-a561-ccca72c2cde1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:39:05.943124 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:05.943106 5030 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-model-cache\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:05.943218 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:05.943146 5030 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-home\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:05.943218 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:05.943162 5030 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-tmp-dir\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:05.944578 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:05.944549 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-dshm" pod "295a2c1a-9e30-4fd1-a561-ccca72c2cde1" (UID: "295a2c1a-9e30-4fd1-a561-ccca72c2cde1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:39:05.944925 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:05.944902 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-tls-certs" pod "295a2c1a-9e30-4fd1-a561-ccca72c2cde1" (UID: "295a2c1a-9e30-4fd1-a561-ccca72c2cde1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 07:39:05.945013 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:05.944990 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-kube-api-access-5m7pl" pod "295a2c1a-9e30-4fd1-a561-ccca72c2cde1" (UID: "295a2c1a-9e30-4fd1-a561-ccca72c2cde1"). InnerVolumeSpecName "kube-api-access-5m7pl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:39:06.044832 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:06.044749 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5m7pl\" (UniqueName: \"kubernetes.io/projected/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-kube-api-access-5m7pl\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:06.044832 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:06.044790 5030 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-dshm\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:06.044832 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:06.044806 5030 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/295a2c1a-9e30-4fd1-a561-ccca72c2cde1-tls-certs\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:06.401641 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:06.401603 5030 generic.go:356] "Generic (PLEG): container finished" podID="295a2c1a-9e30-4fd1-a561-ccca72c2cde1" containerID="253fb9645bcbd6edbbb81c2b1f12a1befba44a1aef3849509e53ae4554db1fb0" exitCode=0 Nov 04 07:39:06.401812 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:06.401668 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" event={"ID":"295a2c1a-9e30-4fd1-a561-ccca72c2cde1","Type":"ContainerDied","Data":"253fb9645bcbd6edbbb81c2b1f12a1befba44a1aef3849509e53ae4554db1fb0"} Nov 04 07:39:06.401812 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:06.401699 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" event={"ID":"295a2c1a-9e30-4fd1-a561-ccca72c2cde1","Type":"ContainerDied","Data":"27c7d10294e09917ea88ae2b3a27b379f1a675125015801b1f03190aef62dafd"} Nov 04 07:39:06.401812 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:06.401716 5030 scope.go:122] "RemoveContainer" containerID="253fb9645bcbd6edbbb81c2b1f12a1befba44a1aef3849509e53ae4554db1fb0" Nov 04 07:39:06.401812 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:06.401670 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8" Nov 04 07:39:06.411591 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:06.411540 5030 scope.go:122] "RemoveContainer" containerID="253fb9645bcbd6edbbb81c2b1f12a1befba44a1aef3849509e53ae4554db1fb0" Nov 04 07:39:06.411847 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:39:06.411829 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"253fb9645bcbd6edbbb81c2b1f12a1befba44a1aef3849509e53ae4554db1fb0\": container with ID starting with 253fb9645bcbd6edbbb81c2b1f12a1befba44a1aef3849509e53ae4554db1fb0 not found: ID does not exist" containerID="253fb9645bcbd6edbbb81c2b1f12a1befba44a1aef3849509e53ae4554db1fb0" Nov 04 07:39:06.411894 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:06.411857 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"253fb9645bcbd6edbbb81c2b1f12a1befba44a1aef3849509e53ae4554db1fb0"} err="failed to get container status \"253fb9645bcbd6edbbb81c2b1f12a1befba44a1aef3849509e53ae4554db1fb0\": rpc error: code = NotFound desc = could not find container \"253fb9645bcbd6edbbb81c2b1f12a1befba44a1aef3849509e53ae4554db1fb0\": container with ID starting with 253fb9645bcbd6edbbb81c2b1f12a1befba44a1aef3849509e53ae4554db1fb0 not found: ID does not exist" Nov 04 07:39:06.430413 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:06.430385 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8"] Nov 04 07:39:06.433361 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:06.433324 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-60ed4a/premium-w3-60ed4a-kserve-6445bd9cbc-xrvf8"] Nov 04 07:39:08.147565 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:08.147528 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="295a2c1a-9e30-4fd1-a561-ccca72c2cde1" path="/var/lib/kubelet/pods/295a2c1a-9e30-4fd1-a561-ccca72c2cde1/volumes" Nov 04 07:39:14.545016 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.544967 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr"] Nov 04 07:39:14.550917 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.550866 5030 cpu_manager.go:414] "containerMap: removing container" podUID="295a2c1a-9e30-4fd1-a561-ccca72c2cde1" containerName="main" Nov 04 07:39:14.551100 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.551074 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="295a2c1a-9e30-4fd1-a561-ccca72c2cde1" containerName="main" Nov 04 07:39:14.551495 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.551474 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="295a2c1a-9e30-4fd1-a561-ccca72c2cde1" containerName="main" Nov 04 07:39:14.557089 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.557059 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.593457 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.593424 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr"] Nov 04 07:39:14.641981 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.641948 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-credential-socket\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.642209 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.642003 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12690e98-f768-42db-a92a-cb1ce80bec42-istio-token\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.642209 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.642162 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-istio-data\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.642333 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.642208 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-workload-certs\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.642374 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.642328 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-istio-envoy\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.642374 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.642349 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12690e98-f768-42db-a92a-cb1ce80bec42-istio-podinfo\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.642458 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.642373 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qscqt\" (UniqueName: \"kubernetes.io/projected/12690e98-f768-42db-a92a-cb1ce80bec42-kube-api-access-qscqt\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.642525 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.642499 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12690e98-f768-42db-a92a-cb1ce80bec42-istiod-ca-cert\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.642653 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.642630 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-workload-socket\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.743730 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.743705 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-istio-envoy\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.743730 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.743733 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12690e98-f768-42db-a92a-cb1ce80bec42-istio-podinfo\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.743947 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.743760 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qscqt\" (UniqueName: \"kubernetes.io/projected/12690e98-f768-42db-a92a-cb1ce80bec42-kube-api-access-qscqt\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.743947 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.743795 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12690e98-f768-42db-a92a-cb1ce80bec42-istiod-ca-cert\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.743947 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.743860 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-workload-socket\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.743947 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.743910 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-credential-socket\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.744223 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.743962 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12690e98-f768-42db-a92a-cb1ce80bec42-istio-token\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.744223 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.744014 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-istio-data\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.744223 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.744056 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-workload-certs\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.744406 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.744260 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-workload-socket\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.744463 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.744436 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-workload-certs\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.744515 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.744479 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-istio-data\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.744579 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.744520 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-credential-socket\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.744782 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.744751 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12690e98-f768-42db-a92a-cb1ce80bec42-istiod-ca-cert\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.746559 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.746537 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-istio-envoy\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.746672 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.746579 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12690e98-f768-42db-a92a-cb1ce80bec42-istio-podinfo\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.758037 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.758017 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12690e98-f768-42db-a92a-cb1ce80bec42-istio-token\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.767328 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.767305 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qscqt\" (UniqueName: \"kubernetes.io/projected/12690e98-f768-42db-a92a-cb1ce80bec42-kube-api-access-qscqt\") pod \"e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:14.893442 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:14.893362 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:15.210819 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:15.210790 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr"] Nov 04 07:39:15.214197 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:39:15.214167 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12690e98_f768_42db_a92a_cb1ce80bec42.slice/crio-c0623c8bda00cd485166084d08995420ae38eb782a9f107b22bf9f3de1e1fcfc WatchSource:0}: Error finding container c0623c8bda00cd485166084d08995420ae38eb782a9f107b22bf9f3de1e1fcfc: Status 404 returned error can't find the container with id c0623c8bda00cd485166084d08995420ae38eb782a9f107b22bf9f3de1e1fcfc Nov 04 07:39:15.217100 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:15.217066 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:39:15.217212 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:15.217165 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:39:15.217280 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:15.217216 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:39:15.490243 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:15.490103 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" event={"ID":"12690e98-f768-42db-a92a-cb1ce80bec42","Type":"ContainerStarted","Data":"da631bff8185998c70c342d1393672201fef67a4a84194bf24128d664a0ac476"} Nov 04 07:39:15.490243 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:15.490210 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" event={"ID":"12690e98-f768-42db-a92a-cb1ce80bec42","Type":"ContainerStarted","Data":"c0623c8bda00cd485166084d08995420ae38eb782a9f107b22bf9f3de1e1fcfc"} Nov 04 07:39:15.520064 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:15.519990 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" podStartSLOduration=1.519954692 podStartE2EDuration="1.519954692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:39:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:39:15.517969567 +0000 UTC m=+1429.500597796" watchObservedRunningTime="2026-11-04 07:39:15.519954692 +0000 UTC m=+1429.502582885" Nov 04 07:39:15.894293 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:15.894222 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:16.895959 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:16.895912 5030 patch_prober.go:29] interesting pod/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Nov 04 07:39:16.896468 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:16.896008 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" podUID="12690e98-f768-42db-a92a-cb1ce80bec42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Nov 04 07:39:17.893926 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:17.893893 5030 patch_prober.go:29] interesting pod/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Nov 04 07:39:17.894078 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:17.893946 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" podUID="12690e98-f768-42db-a92a-cb1ce80bec42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Nov 04 07:39:18.893725 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:18.893686 5030 patch_prober.go:29] interesting pod/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Nov 04 07:39:18.894158 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:18.893741 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" podUID="12690e98-f768-42db-a92a-cb1ce80bec42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Nov 04 07:39:19.893919 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:19.893883 5030 patch_prober.go:29] interesting pod/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Nov 04 07:39:19.894353 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:19.893942 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" podUID="12690e98-f768-42db-a92a-cb1ce80bec42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Nov 04 07:39:20.894208 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:20.894172 5030 patch_prober.go:29] interesting pod/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Nov 04 07:39:20.894632 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:20.894228 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" podUID="12690e98-f768-42db-a92a-cb1ce80bec42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Nov 04 07:39:21.894147 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:21.894102 5030 patch_prober.go:29] interesting pod/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Nov 04 07:39:21.894323 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:21.894185 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" podUID="12690e98-f768-42db-a92a-cb1ce80bec42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Nov 04 07:39:22.162318 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:39:22.162229 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:39:22.898030 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:22.898004 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:22.898475 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:22.898374 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:22.899074 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:22.899053 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:23.664214 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:23.664179 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:39:38.969338 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:38.969242 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp"] Nov 04 07:39:38.970469 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:38.970432 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" podUID="cf999862-2c2c-41ab-a950-a0935b6dec14" containerName="istio-proxy" containerID="cri-o://e517d679b4cf6cbff682731c48dc4136b14431100296d17139efc63009e73ec5" gracePeriod=30 Nov 04 07:39:38.977214 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:38.977178 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr"] Nov 04 07:39:38.979117 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:38.979045 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" podUID="12690e98-f768-42db-a92a-cb1ce80bec42" containerName="istio-proxy" containerID="cri-o://da631bff8185998c70c342d1393672201fef67a4a84194bf24128d664a0ac476" gracePeriod=30 Nov 04 07:39:38.982719 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:38.981019 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx"] Nov 04 07:39:38.982719 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:38.981219 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" podUID="89f8ea73-a637-4f9b-bd7c-bee93b531406" containerName="istio-proxy" containerID="cri-o://a5845cfa1806ba5508b378140c7427600e55710fc076ed0d8d7182fe2232d167" gracePeriod=30 Nov 04 07:39:41.553052 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:41.553016 5030 patch_prober.go:29] interesting pod/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 07:39:41.553590 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:41.553077 5030 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" podUID="cf999862-2c2c-41ab-a950-a0935b6dec14" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 07:39:44.411384 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.411346 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:44.470692 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.470391 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:39:44.493825 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.493796 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:39:44.577797 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.577714 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-workload-certs\") pod \"89f8ea73-a637-4f9b-bd7c-bee93b531406\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " Nov 04 07:39:44.577797 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.577776 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/12690e98-f768-42db-a92a-cb1ce80bec42-istio-token\" (UniqueName: \"kubernetes.io/projected/12690e98-f768-42db-a92a-cb1ce80bec42-istio-token\") pod \"12690e98-f768-42db-a92a-cb1ce80bec42\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " Nov 04 07:39:44.578029 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.577803 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/89f8ea73-a637-4f9b-bd7c-bee93b531406-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89f8ea73-a637-4f9b-bd7c-bee93b531406-istiod-ca-cert\") pod \"89f8ea73-a637-4f9b-bd7c-bee93b531406\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " Nov 04 07:39:44.578029 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.577823 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/89f8ea73-a637-4f9b-bd7c-bee93b531406-kube-api-access-jhkhd\" (UniqueName: \"kubernetes.io/projected/89f8ea73-a637-4f9b-bd7c-bee93b531406-kube-api-access-jhkhd\") pod \"89f8ea73-a637-4f9b-bd7c-bee93b531406\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " Nov 04 07:39:44.578029 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.577850 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-workload-certs\") pod \"12690e98-f768-42db-a92a-cb1ce80bec42\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " Nov 04 07:39:44.578029 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.577913 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-data\") pod \"89f8ea73-a637-4f9b-bd7c-bee93b531406\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " Nov 04 07:39:44.578029 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.577973 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-workload-socket\") pod \"89f8ea73-a637-4f9b-bd7c-bee93b531406\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " Nov 04 07:39:44.578029 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.578004 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-istio-data\") pod \"12690e98-f768-42db-a92a-cb1ce80bec42\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " Nov 04 07:39:44.578367 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.578031 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-workload-certs" pod "89f8ea73-a637-4f9b-bd7c-bee93b531406" (UID: "89f8ea73-a637-4f9b-bd7c-bee93b531406"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:39:44.578367 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.578038 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-credential-socket\") pod \"89f8ea73-a637-4f9b-bd7c-bee93b531406\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " Nov 04 07:39:44.578367 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.578121 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-podinfo\") pod \"89f8ea73-a637-4f9b-bd7c-bee93b531406\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " Nov 04 07:39:44.578367 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.578238 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-workload-socket\") pod \"12690e98-f768-42db-a92a-cb1ce80bec42\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " Nov 04 07:39:44.578367 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.578240 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-data" pod "89f8ea73-a637-4f9b-bd7c-bee93b531406" (UID: "89f8ea73-a637-4f9b-bd7c-bee93b531406"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:39:44.578367 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.578253 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-workload-certs" pod "12690e98-f768-42db-a92a-cb1ce80bec42" (UID: "12690e98-f768-42db-a92a-cb1ce80bec42"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:39:44.578367 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.578294 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/12690e98-f768-42db-a92a-cb1ce80bec42-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12690e98-f768-42db-a92a-cb1ce80bec42-istiod-ca-cert\") pod \"12690e98-f768-42db-a92a-cb1ce80bec42\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " Nov 04 07:39:44.578367 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.578312 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-istio-data" pod "12690e98-f768-42db-a92a-cb1ce80bec42" (UID: "12690e98-f768-42db-a92a-cb1ce80bec42"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:39:44.578367 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.578350 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-token\" (UniqueName: \"kubernetes.io/projected/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-token\") pod \"89f8ea73-a637-4f9b-bd7c-bee93b531406\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " Nov 04 07:39:44.578780 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.578390 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-envoy\") pod \"89f8ea73-a637-4f9b-bd7c-bee93b531406\" (UID: \"89f8ea73-a637-4f9b-bd7c-bee93b531406\") " Nov 04 07:39:44.578780 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.578425 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/12690e98-f768-42db-a92a-cb1ce80bec42-kube-api-access-qscqt\" (UniqueName: \"kubernetes.io/projected/12690e98-f768-42db-a92a-cb1ce80bec42-kube-api-access-qscqt\") pod \"12690e98-f768-42db-a92a-cb1ce80bec42\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " Nov 04 07:39:44.578780 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.578480 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-workload-socket" pod "12690e98-f768-42db-a92a-cb1ce80bec42" (UID: "12690e98-f768-42db-a92a-cb1ce80bec42"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:39:44.578780 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.578488 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-credential-socket\") pod \"12690e98-f768-42db-a92a-cb1ce80bec42\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " Nov 04 07:39:44.578780 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.578489 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-credential-socket" pod "89f8ea73-a637-4f9b-bd7c-bee93b531406" (UID: "89f8ea73-a637-4f9b-bd7c-bee93b531406"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:39:44.578780 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.578503 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-workload-socket" pod "89f8ea73-a637-4f9b-bd7c-bee93b531406" (UID: "89f8ea73-a637-4f9b-bd7c-bee93b531406"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:39:44.578780 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.578561 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-istio-envoy\") pod \"12690e98-f768-42db-a92a-cb1ce80bec42\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " Nov 04 07:39:44.578780 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.578601 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/12690e98-f768-42db-a92a-cb1ce80bec42-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12690e98-f768-42db-a92a-cb1ce80bec42-istio-podinfo\") pod \"12690e98-f768-42db-a92a-cb1ce80bec42\" (UID: \"12690e98-f768-42db-a92a-cb1ce80bec42\") " Nov 04 07:39:44.579186 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.578864 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12690e98-f768-42db-a92a-cb1ce80bec42-istiod-ca-cert" pod "12690e98-f768-42db-a92a-cb1ce80bec42" (UID: "12690e98-f768-42db-a92a-cb1ce80bec42"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 07:39:44.579186 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.578922 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89f8ea73-a637-4f9b-bd7c-bee93b531406-istiod-ca-cert" pod "89f8ea73-a637-4f9b-bd7c-bee93b531406" (UID: "89f8ea73-a637-4f9b-bd7c-bee93b531406"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 07:39:44.579261 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.579200 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-credential-socket" pod "12690e98-f768-42db-a92a-cb1ce80bec42" (UID: "12690e98-f768-42db-a92a-cb1ce80bec42"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:39:44.579316 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.579286 5030 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12690e98-f768-42db-a92a-cb1ce80bec42-istiod-ca-cert\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.579391 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.579318 5030 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-workload-certs\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.579391 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.579334 5030 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89f8ea73-a637-4f9b-bd7c-bee93b531406-istiod-ca-cert\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.579391 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.579348 5030 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-workload-certs\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.579391 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.579363 5030 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-data\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.579391 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.579378 5030 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-workload-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.579647 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.579393 5030 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-istio-data\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.579647 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.579408 5030 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-credential-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.579647 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.579423 5030 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-workload-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.580853 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.580783 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89f8ea73-a637-4f9b-bd7c-bee93b531406-kube-api-access-jhkhd" pod "89f8ea73-a637-4f9b-bd7c-bee93b531406" (UID: "89f8ea73-a637-4f9b-bd7c-bee93b531406"). InnerVolumeSpecName "kube-api-access-jhkhd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:39:44.580978 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.580958 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-token" pod "89f8ea73-a637-4f9b-bd7c-bee93b531406" (UID: "89f8ea73-a637-4f9b-bd7c-bee93b531406"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:39:44.581081 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.581061 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12690e98-f768-42db-a92a-cb1ce80bec42-istio-token" pod "12690e98-f768-42db-a92a-cb1ce80bec42" (UID: "12690e98-f768-42db-a92a-cb1ce80bec42"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:39:44.581369 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.581341 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/12690e98-f768-42db-a92a-cb1ce80bec42-istio-podinfo" pod "12690e98-f768-42db-a92a-cb1ce80bec42" (UID: "12690e98-f768-42db-a92a-cb1ce80bec42"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 07:39:44.581470 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.581395 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-envoy" pod "89f8ea73-a637-4f9b-bd7c-bee93b531406" (UID: "89f8ea73-a637-4f9b-bd7c-bee93b531406"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:39:44.581540 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.581529 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12690e98-f768-42db-a92a-cb1ce80bec42-kube-api-access-qscqt" pod "12690e98-f768-42db-a92a-cb1ce80bec42" (UID: "12690e98-f768-42db-a92a-cb1ce80bec42"). InnerVolumeSpecName "kube-api-access-qscqt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:39:44.581846 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.581831 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-podinfo" pod "89f8ea73-a637-4f9b-bd7c-bee93b531406" (UID: "89f8ea73-a637-4f9b-bd7c-bee93b531406"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 07:39:44.582113 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.582100 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-istio-envoy" pod "12690e98-f768-42db-a92a-cb1ce80bec42" (UID: "12690e98-f768-42db-a92a-cb1ce80bec42"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:39:44.680188 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.680150 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cf999862-2c2c-41ab-a950-a0935b6dec14-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf999862-2c2c-41ab-a950-a0935b6dec14-istiod-ca-cert\") pod \"cf999862-2c2c-41ab-a950-a0935b6dec14\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " Nov 04 07:39:44.680364 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.680210 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-token\" (UniqueName: \"kubernetes.io/projected/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-token\") pod \"cf999862-2c2c-41ab-a950-a0935b6dec14\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " Nov 04 07:39:44.680364 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.680258 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-workload-certs\") pod \"cf999862-2c2c-41ab-a950-a0935b6dec14\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " Nov 04 07:39:44.680364 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.680295 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-envoy\") pod \"cf999862-2c2c-41ab-a950-a0935b6dec14\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " Nov 04 07:39:44.680364 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.680322 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-credential-socket\") pod \"cf999862-2c2c-41ab-a950-a0935b6dec14\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " Nov 04 07:39:44.680364 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.680361 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-data\") pod \"cf999862-2c2c-41ab-a950-a0935b6dec14\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " Nov 04 07:39:44.680648 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.680402 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-workload-socket\") pod \"cf999862-2c2c-41ab-a950-a0935b6dec14\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " Nov 04 07:39:44.680648 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.680472 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf999862-2c2c-41ab-a950-a0935b6dec14-kube-api-access-455bz\" (UniqueName: \"kubernetes.io/projected/cf999862-2c2c-41ab-a950-a0935b6dec14-kube-api-access-455bz\") pod \"cf999862-2c2c-41ab-a950-a0935b6dec14\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " Nov 04 07:39:44.680648 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.680557 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-podinfo\") pod \"cf999862-2c2c-41ab-a950-a0935b6dec14\" (UID: \"cf999862-2c2c-41ab-a950-a0935b6dec14\") " Nov 04 07:39:44.680648 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.680575 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf999862-2c2c-41ab-a950-a0935b6dec14-istiod-ca-cert" pod "cf999862-2c2c-41ab-a950-a0935b6dec14" (UID: "cf999862-2c2c-41ab-a950-a0935b6dec14"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 07:39:44.680850 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.680735 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-workload-socket" pod "cf999862-2c2c-41ab-a950-a0935b6dec14" (UID: "cf999862-2c2c-41ab-a950-a0935b6dec14"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:39:44.680910 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.680860 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-credential-socket" pod "cf999862-2c2c-41ab-a950-a0935b6dec14" (UID: "cf999862-2c2c-41ab-a950-a0935b6dec14"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:39:44.680965 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.680925 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-workload-certs" pod "cf999862-2c2c-41ab-a950-a0935b6dec14" (UID: "cf999862-2c2c-41ab-a950-a0935b6dec14"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:39:44.681020 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.680968 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-data" pod "cf999862-2c2c-41ab-a950-a0935b6dec14" (UID: "cf999862-2c2c-41ab-a950-a0935b6dec14"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:39:44.681207 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.681185 5030 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-token\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.681304 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.681210 5030 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-envoy\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.681304 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.681226 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qscqt\" (UniqueName: \"kubernetes.io/projected/12690e98-f768-42db-a92a-cb1ce80bec42-kube-api-access-qscqt\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.681304 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.681242 5030 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-workload-certs\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.681304 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.681257 5030 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-credential-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.681304 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.681271 5030 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-credential-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.681304 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.681285 5030 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-data\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.681304 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.681299 5030 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12690e98-f768-42db-a92a-cb1ce80bec42-istio-envoy\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.681584 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.681313 5030 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12690e98-f768-42db-a92a-cb1ce80bec42-istio-podinfo\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.681584 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.681325 5030 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-workload-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.681584 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.681339 5030 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12690e98-f768-42db-a92a-cb1ce80bec42-istio-token\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.681584 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.681352 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhkhd\" (UniqueName: \"kubernetes.io/projected/89f8ea73-a637-4f9b-bd7c-bee93b531406-kube-api-access-jhkhd\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.681584 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.681366 5030 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89f8ea73-a637-4f9b-bd7c-bee93b531406-istio-podinfo\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.681584 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.681403 5030 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf999862-2c2c-41ab-a950-a0935b6dec14-istiod-ca-cert\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.682752 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.682729 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-podinfo" pod "cf999862-2c2c-41ab-a950-a0935b6dec14" (UID: "cf999862-2c2c-41ab-a950-a0935b6dec14"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 07:39:44.682946 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.682927 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-token" pod "cf999862-2c2c-41ab-a950-a0935b6dec14" (UID: "cf999862-2c2c-41ab-a950-a0935b6dec14"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:39:44.682997 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.682952 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf999862-2c2c-41ab-a950-a0935b6dec14-kube-api-access-455bz" pod "cf999862-2c2c-41ab-a950-a0935b6dec14" (UID: "cf999862-2c2c-41ab-a950-a0935b6dec14"). InnerVolumeSpecName "kube-api-access-455bz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:39:44.683316 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.683296 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-envoy" pod "cf999862-2c2c-41ab-a950-a0935b6dec14" (UID: "cf999862-2c2c-41ab-a950-a0935b6dec14"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:39:44.782687 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.782637 5030 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-token\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.782687 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.782671 5030 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-envoy\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.782687 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.782690 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-455bz\" (UniqueName: \"kubernetes.io/projected/cf999862-2c2c-41ab-a950-a0935b6dec14-kube-api-access-455bz\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.782890 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.782704 5030 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf999862-2c2c-41ab-a950-a0935b6dec14-istio-podinfo\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:39:44.787127 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.787093 5030 generic.go:356] "Generic (PLEG): container finished" podID="89f8ea73-a637-4f9b-bd7c-bee93b531406" containerID="a5845cfa1806ba5508b378140c7427600e55710fc076ed0d8d7182fe2232d167" exitCode=0 Nov 04 07:39:44.787287 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.787167 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" event={"ID":"89f8ea73-a637-4f9b-bd7c-bee93b531406","Type":"ContainerDied","Data":"a5845cfa1806ba5508b378140c7427600e55710fc076ed0d8d7182fe2232d167"} Nov 04 07:39:44.787287 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.787186 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" Nov 04 07:39:44.787287 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.787234 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx" event={"ID":"89f8ea73-a637-4f9b-bd7c-bee93b531406","Type":"ContainerDied","Data":"49bbb81f3949ff21697e8530f8ccc1f1e73c7ca46fed4cf56ce472b126674121"} Nov 04 07:39:44.787287 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.787268 5030 scope.go:122] "RemoveContainer" containerID="a5845cfa1806ba5508b378140c7427600e55710fc076ed0d8d7182fe2232d167" Nov 04 07:39:44.790229 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.789181 5030 generic.go:356] "Generic (PLEG): container finished" podID="12690e98-f768-42db-a92a-cb1ce80bec42" containerID="da631bff8185998c70c342d1393672201fef67a4a84194bf24128d664a0ac476" exitCode=0 Nov 04 07:39:44.790229 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.789309 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" Nov 04 07:39:44.790229 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.789357 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" event={"ID":"12690e98-f768-42db-a92a-cb1ce80bec42","Type":"ContainerDied","Data":"da631bff8185998c70c342d1393672201fef67a4a84194bf24128d664a0ac476"} Nov 04 07:39:44.790229 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.789407 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr" event={"ID":"12690e98-f768-42db-a92a-cb1ce80bec42","Type":"ContainerDied","Data":"c0623c8bda00cd485166084d08995420ae38eb782a9f107b22bf9f3de1e1fcfc"} Nov 04 07:39:44.796043 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.791064 5030 generic.go:356] "Generic (PLEG): container finished" podID="cf999862-2c2c-41ab-a950-a0935b6dec14" containerID="e517d679b4cf6cbff682731c48dc4136b14431100296d17139efc63009e73ec5" exitCode=0 Nov 04 07:39:44.796043 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.791242 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" event={"ID":"cf999862-2c2c-41ab-a950-a0935b6dec14","Type":"ContainerDied","Data":"e517d679b4cf6cbff682731c48dc4136b14431100296d17139efc63009e73ec5"} Nov 04 07:39:44.796043 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.791283 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" event={"ID":"cf999862-2c2c-41ab-a950-a0935b6dec14","Type":"ContainerDied","Data":"d7a0152341f518ecdf0f784eaf4b59e663ecf293091a108fc194311070ee8d56"} Nov 04 07:39:44.796043 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.791356 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp" Nov 04 07:39:44.804880 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.804863 5030 scope.go:122] "RemoveContainer" containerID="a5845cfa1806ba5508b378140c7427600e55710fc076ed0d8d7182fe2232d167" Nov 04 07:39:44.805339 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:39:44.805302 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5845cfa1806ba5508b378140c7427600e55710fc076ed0d8d7182fe2232d167\": container with ID starting with a5845cfa1806ba5508b378140c7427600e55710fc076ed0d8d7182fe2232d167 not found: ID does not exist" containerID="a5845cfa1806ba5508b378140c7427600e55710fc076ed0d8d7182fe2232d167" Nov 04 07:39:44.805410 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.805348 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5845cfa1806ba5508b378140c7427600e55710fc076ed0d8d7182fe2232d167"} err="failed to get container status \"a5845cfa1806ba5508b378140c7427600e55710fc076ed0d8d7182fe2232d167\": rpc error: code = NotFound desc = could not find container \"a5845cfa1806ba5508b378140c7427600e55710fc076ed0d8d7182fe2232d167\": container with ID starting with a5845cfa1806ba5508b378140c7427600e55710fc076ed0d8d7182fe2232d167 not found: ID does not exist" Nov 04 07:39:44.805410 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.805373 5030 scope.go:122] "RemoveContainer" containerID="da631bff8185998c70c342d1393672201fef67a4a84194bf24128d664a0ac476" Nov 04 07:39:44.822344 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.822289 5030 scope.go:122] "RemoveContainer" containerID="da631bff8185998c70c342d1393672201fef67a4a84194bf24128d664a0ac476" Nov 04 07:39:44.822731 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:39:44.822699 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da631bff8185998c70c342d1393672201fef67a4a84194bf24128d664a0ac476\": container with ID starting with da631bff8185998c70c342d1393672201fef67a4a84194bf24128d664a0ac476 not found: ID does not exist" containerID="da631bff8185998c70c342d1393672201fef67a4a84194bf24128d664a0ac476" Nov 04 07:39:44.822816 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.822734 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da631bff8185998c70c342d1393672201fef67a4a84194bf24128d664a0ac476"} err="failed to get container status \"da631bff8185998c70c342d1393672201fef67a4a84194bf24128d664a0ac476\": rpc error: code = NotFound desc = could not find container \"da631bff8185998c70c342d1393672201fef67a4a84194bf24128d664a0ac476\": container with ID starting with da631bff8185998c70c342d1393672201fef67a4a84194bf24128d664a0ac476 not found: ID does not exist" Nov 04 07:39:44.822816 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.822757 5030 scope.go:122] "RemoveContainer" containerID="e517d679b4cf6cbff682731c48dc4136b14431100296d17139efc63009e73ec5" Nov 04 07:39:44.825342 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.825321 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx"] Nov 04 07:39:44.828193 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.828085 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-f5qwx"] Nov 04 07:39:44.834363 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.834268 5030 scope.go:122] "RemoveContainer" containerID="e517d679b4cf6cbff682731c48dc4136b14431100296d17139efc63009e73ec5" Nov 04 07:39:44.834602 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:39:44.834581 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e517d679b4cf6cbff682731c48dc4136b14431100296d17139efc63009e73ec5\": container with ID starting with e517d679b4cf6cbff682731c48dc4136b14431100296d17139efc63009e73ec5 not found: ID does not exist" containerID="e517d679b4cf6cbff682731c48dc4136b14431100296d17139efc63009e73ec5" Nov 04 07:39:44.834666 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.834608 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e517d679b4cf6cbff682731c48dc4136b14431100296d17139efc63009e73ec5"} err="failed to get container status \"e517d679b4cf6cbff682731c48dc4136b14431100296d17139efc63009e73ec5\": rpc error: code = NotFound desc = could not find container \"e517d679b4cf6cbff682731c48dc4136b14431100296d17139efc63009e73ec5\": container with ID starting with e517d679b4cf6cbff682731c48dc4136b14431100296d17139efc63009e73ec5 not found: ID does not exist" Nov 04 07:39:44.844646 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.844623 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr"] Nov 04 07:39:44.850385 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.850361 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-cpgbr"] Nov 04 07:39:44.862170 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.862122 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp"] Nov 04 07:39:44.869852 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:44.869827 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-60ed4a-openshift-default-76f5998f8c-6qgmp"] Nov 04 07:39:46.149595 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:46.149004 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="12690e98-f768-42db-a92a-cb1ce80bec42" path="/var/lib/kubelet/pods/12690e98-f768-42db-a92a-cb1ce80bec42/volumes" Nov 04 07:39:46.151559 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:46.150303 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="89f8ea73-a637-4f9b-bd7c-bee93b531406" path="/var/lib/kubelet/pods/89f8ea73-a637-4f9b-bd7c-bee93b531406/volumes" Nov 04 07:39:46.151559 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:46.150965 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cf999862-2c2c-41ab-a950-a0935b6dec14" path="/var/lib/kubelet/pods/cf999862-2c2c-41ab-a950-a0935b6dec14/volumes" Nov 04 07:39:52.144885 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:39:52.144849 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:39:53.146475 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:39:53.146438 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:40:10.020647 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:10.020568 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:40:22.142492 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:40:22.142454 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:40:23.771582 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:23.771549 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2"] Nov 04 07:40:23.772557 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:23.772525 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" podUID="5eb6bbdd-461f-448e-8dee-3e54fd978d09" containerName="istio-proxy" containerID="cri-o://b36dcded00bbb14869cfb47cf37a1650c4c17aa5a63bc728e557d0c8b8ce6ce5" gracePeriod=30 Nov 04 07:40:24.840364 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:24.840328 5030 patch_prober.go:29] interesting pod/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 07:40:24.840800 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:24.840402 5030 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" podUID="5eb6bbdd-461f-448e-8dee-3e54fd978d09" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 07:40:26.323330 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:26.323298 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-9k9rx_ecfd331a-08c4-43ac-a58c-9f43935d06ed/console-operator/2.log" Nov 04 07:40:26.329098 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:26.329076 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4d9w_9084f3dd-8da4-431c-8040-1e268c3fa964/ovn-acl-logging/0.log" Nov 04 07:40:26.330067 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:26.330041 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-9k9rx_ecfd331a-08c4-43ac-a58c-9f43935d06ed/console-operator/2.log" Nov 04 07:40:26.336244 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:26.336224 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c4d9w_9084f3dd-8da4-431c-8040-1e268c3fa964/ovn-acl-logging/0.log" Nov 04 07:40:27.151837 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:27.151805 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:40:29.045368 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.045313 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:40:29.097865 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.097827 5030 generic.go:356] "Generic (PLEG): container finished" podID="5eb6bbdd-461f-448e-8dee-3e54fd978d09" containerID="b36dcded00bbb14869cfb47cf37a1650c4c17aa5a63bc728e557d0c8b8ce6ce5" exitCode=0 Nov 04 07:40:29.098004 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.097874 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" Nov 04 07:40:29.098004 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.097912 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" event={"ID":"5eb6bbdd-461f-448e-8dee-3e54fd978d09","Type":"ContainerDied","Data":"b36dcded00bbb14869cfb47cf37a1650c4c17aa5a63bc728e557d0c8b8ce6ce5"} Nov 04 07:40:29.098004 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.097981 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2" event={"ID":"5eb6bbdd-461f-448e-8dee-3e54fd978d09","Type":"ContainerDied","Data":"f905bff104c9c2b1b5168052a0274aa4157f6e8624000c81d8fe823fa41a6e6f"} Nov 04 07:40:29.098230 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.098013 5030 scope.go:122] "RemoveContainer" containerID="b36dcded00bbb14869cfb47cf37a1650c4c17aa5a63bc728e557d0c8b8ce6ce5" Nov 04 07:40:29.108011 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.107917 5030 scope.go:122] "RemoveContainer" containerID="38fc708ad0db4ff640841377205d916f33ac04fc8772d91b6c1618fd13d26a44" Nov 04 07:40:29.118041 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.118018 5030 scope.go:122] "RemoveContainer" containerID="b36dcded00bbb14869cfb47cf37a1650c4c17aa5a63bc728e557d0c8b8ce6ce5" Nov 04 07:40:29.118684 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:40:29.118433 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b36dcded00bbb14869cfb47cf37a1650c4c17aa5a63bc728e557d0c8b8ce6ce5\": container with ID starting with b36dcded00bbb14869cfb47cf37a1650c4c17aa5a63bc728e557d0c8b8ce6ce5 not found: ID does not exist" containerID="b36dcded00bbb14869cfb47cf37a1650c4c17aa5a63bc728e557d0c8b8ce6ce5" Nov 04 07:40:29.118684 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.118493 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b36dcded00bbb14869cfb47cf37a1650c4c17aa5a63bc728e557d0c8b8ce6ce5"} err="failed to get container status \"b36dcded00bbb14869cfb47cf37a1650c4c17aa5a63bc728e557d0c8b8ce6ce5\": rpc error: code = NotFound desc = could not find container \"b36dcded00bbb14869cfb47cf37a1650c4c17aa5a63bc728e557d0c8b8ce6ce5\": container with ID starting with b36dcded00bbb14869cfb47cf37a1650c4c17aa5a63bc728e557d0c8b8ce6ce5 not found: ID does not exist" Nov 04 07:40:29.118684 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.118517 5030 scope.go:122] "RemoveContainer" containerID="38fc708ad0db4ff640841377205d916f33ac04fc8772d91b6c1618fd13d26a44" Nov 04 07:40:29.118920 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:40:29.118854 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38fc708ad0db4ff640841377205d916f33ac04fc8772d91b6c1618fd13d26a44\": container with ID starting with 38fc708ad0db4ff640841377205d916f33ac04fc8772d91b6c1618fd13d26a44 not found: ID does not exist" containerID="38fc708ad0db4ff640841377205d916f33ac04fc8772d91b6c1618fd13d26a44" Nov 04 07:40:29.118920 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.118886 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38fc708ad0db4ff640841377205d916f33ac04fc8772d91b6c1618fd13d26a44"} err="failed to get container status \"38fc708ad0db4ff640841377205d916f33ac04fc8772d91b6c1618fd13d26a44\": rpc error: code = NotFound desc = could not find container \"38fc708ad0db4ff640841377205d916f33ac04fc8772d91b6c1618fd13d26a44\": container with ID starting with 38fc708ad0db4ff640841377205d916f33ac04fc8772d91b6c1618fd13d26a44 not found: ID does not exist" Nov 04 07:40:29.162532 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.162507 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-podinfo\") pod \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " Nov 04 07:40:29.162632 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.162559 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-workload-socket\") pod \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " Nov 04 07:40:29.162632 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.162589 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-data\") pod \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " Nov 04 07:40:29.162754 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.162714 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-workload-certs\") pod \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " Nov 04 07:40:29.162811 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.162770 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-envoy\") pod \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " Nov 04 07:40:29.162811 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.162798 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5eb6bbdd-461f-448e-8dee-3e54fd978d09-kube-api-access-2hs4j\" (UniqueName: \"kubernetes.io/projected/5eb6bbdd-461f-448e-8dee-3e54fd978d09-kube-api-access-2hs4j\") pod \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " Nov 04 07:40:29.162939 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.162837 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istiod-ca-cert\") pod \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " Nov 04 07:40:29.162939 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.162860 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-workload-socket" pod "5eb6bbdd-461f-448e-8dee-3e54fd978d09" (UID: "5eb6bbdd-461f-448e-8dee-3e54fd978d09"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:40:29.162939 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.162886 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-data" pod "5eb6bbdd-461f-448e-8dee-3e54fd978d09" (UID: "5eb6bbdd-461f-448e-8dee-3e54fd978d09"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:40:29.162939 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.162897 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-credential-socket\") pod \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " Nov 04 07:40:29.163184 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.162974 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-workload-certs" pod "5eb6bbdd-461f-448e-8dee-3e54fd978d09" (UID: "5eb6bbdd-461f-448e-8dee-3e54fd978d09"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:40:29.163184 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.163001 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-token\" (UniqueName: \"kubernetes.io/projected/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-token\") pod \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\" (UID: \"5eb6bbdd-461f-448e-8dee-3e54fd978d09\") " Nov 04 07:40:29.163497 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.163478 5030 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-workload-certs\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:40:29.163563 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.163502 5030 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-workload-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:40:29.163563 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.163516 5030 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-data\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:40:29.163998 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.163961 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-credential-socket" pod "5eb6bbdd-461f-448e-8dee-3e54fd978d09" (UID: "5eb6bbdd-461f-448e-8dee-3e54fd978d09"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:40:29.164103 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.164054 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istiod-ca-cert" pod "5eb6bbdd-461f-448e-8dee-3e54fd978d09" (UID: "5eb6bbdd-461f-448e-8dee-3e54fd978d09"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 07:40:29.164839 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.164814 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-podinfo" pod "5eb6bbdd-461f-448e-8dee-3e54fd978d09" (UID: "5eb6bbdd-461f-448e-8dee-3e54fd978d09"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 07:40:29.165556 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.165537 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eb6bbdd-461f-448e-8dee-3e54fd978d09-kube-api-access-2hs4j" pod "5eb6bbdd-461f-448e-8dee-3e54fd978d09" (UID: "5eb6bbdd-461f-448e-8dee-3e54fd978d09"). InnerVolumeSpecName "kube-api-access-2hs4j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:40:29.165737 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.165715 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-envoy" pod "5eb6bbdd-461f-448e-8dee-3e54fd978d09" (UID: "5eb6bbdd-461f-448e-8dee-3e54fd978d09"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:40:29.165818 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.165797 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-token" pod "5eb6bbdd-461f-448e-8dee-3e54fd978d09" (UID: "5eb6bbdd-461f-448e-8dee-3e54fd978d09"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:40:29.264452 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.264421 5030 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-credential-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:40:29.264452 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.264448 5030 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-token\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:40:29.264452 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.264458 5030 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-podinfo\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:40:29.264709 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.264467 5030 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istio-envoy\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:40:29.264709 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.264476 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hs4j\" (UniqueName: \"kubernetes.io/projected/5eb6bbdd-461f-448e-8dee-3e54fd978d09-kube-api-access-2hs4j\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:40:29.264709 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.264485 5030 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eb6bbdd-461f-448e-8dee-3e54fd978d09-istiod-ca-cert\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:40:29.422712 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.422683 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2"] Nov 04 07:40:29.427347 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:29.427317 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-a-6dd194-openshift-default-6f76f45889-9rnf2"] Nov 04 07:40:30.144570 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:30.144535 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5eb6bbdd-461f-448e-8dee-3e54fd978d09" path="/var/lib/kubelet/pods/5eb6bbdd-461f-448e-8dee-3e54fd978d09/volumes" Nov 04 07:40:41.340443 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:41.340399 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc"] Nov 04 07:40:41.341076 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:41.340635 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc" podUID="416ca8a7-627c-428f-89fd-a7a55b7a8709" containerName="maas-api" containerID="cri-o://7def7d31e864c449903558ee37dfa5c347e183c91fec46b4bb264ecacf7a8c5c" gracePeriod=30 Nov 04 07:40:41.716261 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:41.716233 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc" Nov 04 07:40:41.862928 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:41.862890 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/416ca8a7-627c-428f-89fd-a7a55b7a8709-kube-api-access-9lglp\" (UniqueName: \"kubernetes.io/projected/416ca8a7-627c-428f-89fd-a7a55b7a8709-kube-api-access-9lglp\") pod \"416ca8a7-627c-428f-89fd-a7a55b7a8709\" (UID: \"416ca8a7-627c-428f-89fd-a7a55b7a8709\") " Nov 04 07:40:41.863105 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:41.863039 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/416ca8a7-627c-428f-89fd-a7a55b7a8709-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/416ca8a7-627c-428f-89fd-a7a55b7a8709-openshift-service-ca\") pod \"416ca8a7-627c-428f-89fd-a7a55b7a8709\" (UID: \"416ca8a7-627c-428f-89fd-a7a55b7a8709\") " Nov 04 07:40:41.863176 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:41.863156 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/416ca8a7-627c-428f-89fd-a7a55b7a8709-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/416ca8a7-627c-428f-89fd-a7a55b7a8709-maas-api-tls\") pod \"416ca8a7-627c-428f-89fd-a7a55b7a8709\" (UID: \"416ca8a7-627c-428f-89fd-a7a55b7a8709\") " Nov 04 07:40:41.863226 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:41.863197 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/416ca8a7-627c-428f-89fd-a7a55b7a8709-metrics-certs\" (UniqueName: \"kubernetes.io/secret/416ca8a7-627c-428f-89fd-a7a55b7a8709-metrics-certs\") pod \"416ca8a7-627c-428f-89fd-a7a55b7a8709\" (UID: \"416ca8a7-627c-428f-89fd-a7a55b7a8709\") " Nov 04 07:40:41.863488 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:41.863451 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/416ca8a7-627c-428f-89fd-a7a55b7a8709-openshift-service-ca" pod "416ca8a7-627c-428f-89fd-a7a55b7a8709" (UID: "416ca8a7-627c-428f-89fd-a7a55b7a8709"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 07:40:41.864252 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:41.864224 5030 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/416ca8a7-627c-428f-89fd-a7a55b7a8709-openshift-service-ca\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:40:41.865677 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:41.865645 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/416ca8a7-627c-428f-89fd-a7a55b7a8709-kube-api-access-9lglp" pod "416ca8a7-627c-428f-89fd-a7a55b7a8709" (UID: "416ca8a7-627c-428f-89fd-a7a55b7a8709"). InnerVolumeSpecName "kube-api-access-9lglp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:40:41.865799 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:41.865775 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/416ca8a7-627c-428f-89fd-a7a55b7a8709-maas-api-tls" pod "416ca8a7-627c-428f-89fd-a7a55b7a8709" (UID: "416ca8a7-627c-428f-89fd-a7a55b7a8709"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 07:40:41.866817 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:41.866780 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/416ca8a7-627c-428f-89fd-a7a55b7a8709-metrics-certs" pod "416ca8a7-627c-428f-89fd-a7a55b7a8709" (UID: "416ca8a7-627c-428f-89fd-a7a55b7a8709"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 07:40:41.965811 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:41.965777 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lglp\" (UniqueName: \"kubernetes.io/projected/416ca8a7-627c-428f-89fd-a7a55b7a8709-kube-api-access-9lglp\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:40:41.965811 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:41.965807 5030 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/416ca8a7-627c-428f-89fd-a7a55b7a8709-maas-api-tls\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:40:41.965811 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:41.965816 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/416ca8a7-627c-428f-89fd-a7a55b7a8709-metrics-certs\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:40:42.223654 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:42.223575 5030 generic.go:356] "Generic (PLEG): container finished" podID="416ca8a7-627c-428f-89fd-a7a55b7a8709" containerID="7def7d31e864c449903558ee37dfa5c347e183c91fec46b4bb264ecacf7a8c5c" exitCode=0 Nov 04 07:40:42.223654 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:42.223634 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc" Nov 04 07:40:42.223868 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:42.223662 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc" event={"ID":"416ca8a7-627c-428f-89fd-a7a55b7a8709","Type":"ContainerDied","Data":"7def7d31e864c449903558ee37dfa5c347e183c91fec46b4bb264ecacf7a8c5c"} Nov 04 07:40:42.223868 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:42.223722 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc" event={"ID":"416ca8a7-627c-428f-89fd-a7a55b7a8709","Type":"ContainerDied","Data":"a8cf2e1cc608501e5b94f263133326b3537b8433619099087efee5392d523f8b"} Nov 04 07:40:42.223868 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:42.223744 5030 scope.go:122] "RemoveContainer" containerID="7def7d31e864c449903558ee37dfa5c347e183c91fec46b4bb264ecacf7a8c5c" Nov 04 07:40:42.235063 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:42.235046 5030 scope.go:122] "RemoveContainer" containerID="7def7d31e864c449903558ee37dfa5c347e183c91fec46b4bb264ecacf7a8c5c" Nov 04 07:40:42.235374 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:40:42.235349 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7def7d31e864c449903558ee37dfa5c347e183c91fec46b4bb264ecacf7a8c5c\": container with ID starting with 7def7d31e864c449903558ee37dfa5c347e183c91fec46b4bb264ecacf7a8c5c not found: ID does not exist" containerID="7def7d31e864c449903558ee37dfa5c347e183c91fec46b4bb264ecacf7a8c5c" Nov 04 07:40:42.235459 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:42.235381 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7def7d31e864c449903558ee37dfa5c347e183c91fec46b4bb264ecacf7a8c5c"} err="failed to get container status \"7def7d31e864c449903558ee37dfa5c347e183c91fec46b4bb264ecacf7a8c5c\": rpc error: code = NotFound desc = could not find container \"7def7d31e864c449903558ee37dfa5c347e183c91fec46b4bb264ecacf7a8c5c\": container with ID starting with 7def7d31e864c449903558ee37dfa5c347e183c91fec46b4bb264ecacf7a8c5c not found: ID does not exist" Nov 04 07:40:42.246672 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:42.243407 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc"] Nov 04 07:40:42.253942 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:42.253918 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-812032-5874d669f5-rm7lc"] Nov 04 07:40:44.145535 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:44.145496 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="416ca8a7-627c-428f-89fd-a7a55b7a8709" path="/var/lib/kubelet/pods/416ca8a7-627c-428f-89fd-a7a55b7a8709/volumes" Nov 04 07:40:46.698609 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:46.698573 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x"] Nov 04 07:40:46.699401 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:46.699365 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" podUID="83eac9c0-e44d-49c0-9448-f0034ee0b10f" containerName="istio-proxy" containerID="cri-o://123ae6951da6de9b98018d5d2f446d67b94c66cb6d33a559ca5e4798e209d21f" gracePeriod=30 Nov 04 07:40:47.598033 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:47.597998 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:40:52.033844 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.033814 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:40:52.104530 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.103710 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-envoy\") pod \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " Nov 04 07:40:52.104530 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.103787 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-workload-socket\") pod \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " Nov 04 07:40:52.104530 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.103842 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-credential-socket\") pod \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " Nov 04 07:40:52.104530 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.103882 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-workload-certs\") pod \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " Nov 04 07:40:52.104530 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.103924 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-token\" (UniqueName: \"kubernetes.io/projected/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-token\") pod \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " Nov 04 07:40:52.104530 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.103975 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-data\") pod \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " Nov 04 07:40:52.104530 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.104003 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/83eac9c0-e44d-49c0-9448-f0034ee0b10f-kube-api-access-8q9sg\" (UniqueName: \"kubernetes.io/projected/83eac9c0-e44d-49c0-9448-f0034ee0b10f-kube-api-access-8q9sg\") pod \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " Nov 04 07:40:52.104530 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.104064 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istiod-ca-cert\") pod \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " Nov 04 07:40:52.104530 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.104124 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-podinfo\") pod \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\" (UID: \"83eac9c0-e44d-49c0-9448-f0034ee0b10f\") " Nov 04 07:40:52.127815 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.127321 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-credential-socket" pod "83eac9c0-e44d-49c0-9448-f0034ee0b10f" (UID: "83eac9c0-e44d-49c0-9448-f0034ee0b10f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:40:52.127815 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.127530 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-data" pod "83eac9c0-e44d-49c0-9448-f0034ee0b10f" (UID: "83eac9c0-e44d-49c0-9448-f0034ee0b10f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:40:52.128304 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.128280 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-workload-socket" pod "83eac9c0-e44d-49c0-9448-f0034ee0b10f" (UID: "83eac9c0-e44d-49c0-9448-f0034ee0b10f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:40:52.128737 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.128715 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-workload-certs" pod "83eac9c0-e44d-49c0-9448-f0034ee0b10f" (UID: "83eac9c0-e44d-49c0-9448-f0034ee0b10f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:40:52.188013 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.187472 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-envoy" pod "83eac9c0-e44d-49c0-9448-f0034ee0b10f" (UID: "83eac9c0-e44d-49c0-9448-f0034ee0b10f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:40:52.196488 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.196458 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istiod-ca-cert" pod "83eac9c0-e44d-49c0-9448-f0034ee0b10f" (UID: "83eac9c0-e44d-49c0-9448-f0034ee0b10f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 07:40:52.197302 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.197269 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-podinfo" pod "83eac9c0-e44d-49c0-9448-f0034ee0b10f" (UID: "83eac9c0-e44d-49c0-9448-f0034ee0b10f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 07:40:52.199397 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.199056 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-token" pod "83eac9c0-e44d-49c0-9448-f0034ee0b10f" (UID: "83eac9c0-e44d-49c0-9448-f0034ee0b10f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:40:52.202250 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.201176 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83eac9c0-e44d-49c0-9448-f0034ee0b10f-kube-api-access-8q9sg" pod "83eac9c0-e44d-49c0-9448-f0034ee0b10f" (UID: "83eac9c0-e44d-49c0-9448-f0034ee0b10f"). InnerVolumeSpecName "kube-api-access-8q9sg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:40:52.237485 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.237447 5030 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-credential-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:40:52.239928 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.239900 5030 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-workload-certs\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:40:52.241983 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.241961 5030 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-token\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:40:52.242186 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.242169 5030 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-data\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:40:52.242329 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.242312 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8q9sg\" (UniqueName: \"kubernetes.io/projected/83eac9c0-e44d-49c0-9448-f0034ee0b10f-kube-api-access-8q9sg\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:40:52.242443 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.242430 5030 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istiod-ca-cert\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:40:52.242543 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.242530 5030 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-podinfo\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:40:52.242640 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.242627 5030 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-istio-envoy\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:40:52.242732 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.242722 5030 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83eac9c0-e44d-49c0-9448-f0034ee0b10f-workload-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:40:52.273437 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:40:52.273405 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:40:52.300108 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.300070 5030 generic.go:356] "Generic (PLEG): container finished" podID="83eac9c0-e44d-49c0-9448-f0034ee0b10f" containerID="123ae6951da6de9b98018d5d2f446d67b94c66cb6d33a559ca5e4798e209d21f" exitCode=0 Nov 04 07:40:52.300406 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.300299 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" event={"ID":"83eac9c0-e44d-49c0-9448-f0034ee0b10f","Type":"ContainerDied","Data":"123ae6951da6de9b98018d5d2f446d67b94c66cb6d33a559ca5e4798e209d21f"} Nov 04 07:40:52.300406 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.300348 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" Nov 04 07:40:52.300406 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.300366 5030 scope.go:122] "RemoveContainer" containerID="123ae6951da6de9b98018d5d2f446d67b94c66cb6d33a559ca5e4798e209d21f" Nov 04 07:40:52.300566 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.300354 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x" event={"ID":"83eac9c0-e44d-49c0-9448-f0034ee0b10f","Type":"ContainerDied","Data":"2d7c8eebc688cd3614049e6037bcc4894ec32c0131fed09d1d0f40b7ff04351e"} Nov 04 07:40:52.311355 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.311336 5030 scope.go:122] "RemoveContainer" containerID="18c4dbde2d545bdbd2486c195423448c104718ef4345833fcf4b830597d0ef83" Nov 04 07:40:52.321839 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.321813 5030 scope.go:122] "RemoveContainer" containerID="123ae6951da6de9b98018d5d2f446d67b94c66cb6d33a559ca5e4798e209d21f" Nov 04 07:40:52.322571 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:40:52.322235 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"123ae6951da6de9b98018d5d2f446d67b94c66cb6d33a559ca5e4798e209d21f\": container with ID starting with 123ae6951da6de9b98018d5d2f446d67b94c66cb6d33a559ca5e4798e209d21f not found: ID does not exist" containerID="123ae6951da6de9b98018d5d2f446d67b94c66cb6d33a559ca5e4798e209d21f" Nov 04 07:40:52.322644 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.322588 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"123ae6951da6de9b98018d5d2f446d67b94c66cb6d33a559ca5e4798e209d21f"} err="failed to get container status \"123ae6951da6de9b98018d5d2f446d67b94c66cb6d33a559ca5e4798e209d21f\": rpc error: code = NotFound desc = could not find container \"123ae6951da6de9b98018d5d2f446d67b94c66cb6d33a559ca5e4798e209d21f\": container with ID starting with 123ae6951da6de9b98018d5d2f446d67b94c66cb6d33a559ca5e4798e209d21f not found: ID does not exist" Nov 04 07:40:52.322644 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.322612 5030 scope.go:122] "RemoveContainer" containerID="18c4dbde2d545bdbd2486c195423448c104718ef4345833fcf4b830597d0ef83" Nov 04 07:40:52.322894 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:40:52.322875 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18c4dbde2d545bdbd2486c195423448c104718ef4345833fcf4b830597d0ef83\": container with ID starting with 18c4dbde2d545bdbd2486c195423448c104718ef4345833fcf4b830597d0ef83 not found: ID does not exist" containerID="18c4dbde2d545bdbd2486c195423448c104718ef4345833fcf4b830597d0ef83" Nov 04 07:40:52.322943 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.322903 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18c4dbde2d545bdbd2486c195423448c104718ef4345833fcf4b830597d0ef83"} err="failed to get container status \"18c4dbde2d545bdbd2486c195423448c104718ef4345833fcf4b830597d0ef83\": rpc error: code = NotFound desc = could not find container \"18c4dbde2d545bdbd2486c195423448c104718ef4345833fcf4b830597d0ef83\": container with ID starting with 18c4dbde2d545bdbd2486c195423448c104718ef4345833fcf4b830597d0ef83 not found: ID does not exist" Nov 04 07:40:52.327250 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.327223 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x"] Nov 04 07:40:52.332410 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:52.332382 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-b-812032-openshift-default-9f8549b85-fqs6x"] Nov 04 07:40:54.144850 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:40:54.144820 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="83eac9c0-e44d-49c0-9448-f0034ee0b10f" path="/var/lib/kubelet/pods/83eac9c0-e44d-49c0-9448-f0034ee0b10f/volumes" Nov 04 07:41:00.837909 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:00.837872 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:41:17.085882 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:17.085841 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp"] Nov 04 07:41:17.086490 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:17.086034 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp" podUID="a6a5a285-9b50-4a95-a7db-e920fc79d50a" containerName="maas-api" containerID="cri-o://adbfbcb40f00e99f51d86e08644c3d73f1ee129eff4bf61761f18b93d2301eef" gracePeriod=30 Nov 04 07:41:17.450839 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:17.450733 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp" Nov 04 07:41:17.465782 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:17.465754 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a6a5a285-9b50-4a95-a7db-e920fc79d50a-kube-api-access-cpngm\" (UniqueName: \"kubernetes.io/projected/a6a5a285-9b50-4a95-a7db-e920fc79d50a-kube-api-access-cpngm\") pod \"a6a5a285-9b50-4a95-a7db-e920fc79d50a\" (UID: \"a6a5a285-9b50-4a95-a7db-e920fc79d50a\") " Nov 04 07:41:17.465950 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:17.465931 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a6a5a285-9b50-4a95-a7db-e920fc79d50a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6a5a285-9b50-4a95-a7db-e920fc79d50a-metrics-certs\") pod \"a6a5a285-9b50-4a95-a7db-e920fc79d50a\" (UID: \"a6a5a285-9b50-4a95-a7db-e920fc79d50a\") " Nov 04 07:41:17.466016 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:17.465984 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a6a5a285-9b50-4a95-a7db-e920fc79d50a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6a5a285-9b50-4a95-a7db-e920fc79d50a-maas-api-tls\") pod \"a6a5a285-9b50-4a95-a7db-e920fc79d50a\" (UID: \"a6a5a285-9b50-4a95-a7db-e920fc79d50a\") " Nov 04 07:41:17.466085 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:17.466070 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a6a5a285-9b50-4a95-a7db-e920fc79d50a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6a5a285-9b50-4a95-a7db-e920fc79d50a-openshift-service-ca\") pod \"a6a5a285-9b50-4a95-a7db-e920fc79d50a\" (UID: \"a6a5a285-9b50-4a95-a7db-e920fc79d50a\") " Nov 04 07:41:17.466490 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:17.466462 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6a5a285-9b50-4a95-a7db-e920fc79d50a-openshift-service-ca" pod "a6a5a285-9b50-4a95-a7db-e920fc79d50a" (UID: "a6a5a285-9b50-4a95-a7db-e920fc79d50a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 07:41:17.467946 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:17.467924 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6a5a285-9b50-4a95-a7db-e920fc79d50a-kube-api-access-cpngm" pod "a6a5a285-9b50-4a95-a7db-e920fc79d50a" (UID: "a6a5a285-9b50-4a95-a7db-e920fc79d50a"). InnerVolumeSpecName "kube-api-access-cpngm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:41:17.468360 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:17.468338 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6a5a285-9b50-4a95-a7db-e920fc79d50a-metrics-certs" pod "a6a5a285-9b50-4a95-a7db-e920fc79d50a" (UID: "a6a5a285-9b50-4a95-a7db-e920fc79d50a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 07:41:17.468483 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:17.468467 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6a5a285-9b50-4a95-a7db-e920fc79d50a-maas-api-tls" pod "a6a5a285-9b50-4a95-a7db-e920fc79d50a" (UID: "a6a5a285-9b50-4a95-a7db-e920fc79d50a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 07:41:17.567560 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:17.567531 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6a5a285-9b50-4a95-a7db-e920fc79d50a-metrics-certs\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:41:17.567560 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:17.567557 5030 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6a5a285-9b50-4a95-a7db-e920fc79d50a-maas-api-tls\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:41:17.567725 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:17.567567 5030 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6a5a285-9b50-4a95-a7db-e920fc79d50a-openshift-service-ca\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:41:17.567725 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:17.567576 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpngm\" (UniqueName: \"kubernetes.io/projected/a6a5a285-9b50-4a95-a7db-e920fc79d50a-kube-api-access-cpngm\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:41:17.622012 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:17.621984 5030 generic.go:356] "Generic (PLEG): container finished" podID="a6a5a285-9b50-4a95-a7db-e920fc79d50a" containerID="adbfbcb40f00e99f51d86e08644c3d73f1ee129eff4bf61761f18b93d2301eef" exitCode=0 Nov 04 07:41:17.622149 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:17.622048 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp" Nov 04 07:41:17.622149 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:17.622055 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp" event={"ID":"a6a5a285-9b50-4a95-a7db-e920fc79d50a","Type":"ContainerDied","Data":"adbfbcb40f00e99f51d86e08644c3d73f1ee129eff4bf61761f18b93d2301eef"} Nov 04 07:41:17.622149 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:17.622107 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp" event={"ID":"a6a5a285-9b50-4a95-a7db-e920fc79d50a","Type":"ContainerDied","Data":"67ebd5bee2c127af35a207fd8ac1a8a731a91f2b31ea31ad9c3000f410fb178e"} Nov 04 07:41:17.622149 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:17.622146 5030 scope.go:122] "RemoveContainer" containerID="adbfbcb40f00e99f51d86e08644c3d73f1ee129eff4bf61761f18b93d2301eef" Nov 04 07:41:17.632054 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:17.632034 5030 scope.go:122] "RemoveContainer" containerID="adbfbcb40f00e99f51d86e08644c3d73f1ee129eff4bf61761f18b93d2301eef" Nov 04 07:41:17.632456 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:41:17.632432 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adbfbcb40f00e99f51d86e08644c3d73f1ee129eff4bf61761f18b93d2301eef\": container with ID starting with adbfbcb40f00e99f51d86e08644c3d73f1ee129eff4bf61761f18b93d2301eef not found: ID does not exist" containerID="adbfbcb40f00e99f51d86e08644c3d73f1ee129eff4bf61761f18b93d2301eef" Nov 04 07:41:17.632551 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:17.632483 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adbfbcb40f00e99f51d86e08644c3d73f1ee129eff4bf61761f18b93d2301eef"} err="failed to get container status \"adbfbcb40f00e99f51d86e08644c3d73f1ee129eff4bf61761f18b93d2301eef\": rpc error: code = NotFound desc = could not find container \"adbfbcb40f00e99f51d86e08644c3d73f1ee129eff4bf61761f18b93d2301eef\": container with ID starting with adbfbcb40f00e99f51d86e08644c3d73f1ee129eff4bf61761f18b93d2301eef not found: ID does not exist" Nov 04 07:41:17.660934 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:17.658773 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp"] Nov 04 07:41:17.662457 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:17.662426 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-29d3ee-5fb8c8f8b6-z56dp"] Nov 04 07:41:18.145065 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:18.145023 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a6a5a285-9b50-4a95-a7db-e920fc79d50a" path="/var/lib/kubelet/pods/a6a5a285-9b50-4a95-a7db-e920fc79d50a/volumes" Nov 04 07:41:19.129310 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:19.129270 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:41:22.292163 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:41:22.289450 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:41:24.810334 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.810301 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl"] Nov 04 07:41:24.810969 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.810954 5030 cpu_manager.go:414] "containerMap: removing container" podUID="5eb6bbdd-461f-448e-8dee-3e54fd978d09" containerName="istio-proxy" Nov 04 07:41:24.811018 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.810971 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5eb6bbdd-461f-448e-8dee-3e54fd978d09" containerName="istio-proxy" Nov 04 07:41:24.811018 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.810989 5030 cpu_manager.go:414] "containerMap: removing container" podUID="416ca8a7-627c-428f-89fd-a7a55b7a8709" containerName="maas-api" Nov 04 07:41:24.811018 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.810996 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="416ca8a7-627c-428f-89fd-a7a55b7a8709" containerName="maas-api" Nov 04 07:41:24.811018 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.811011 5030 cpu_manager.go:414] "containerMap: removing container" podUID="5eb6bbdd-461f-448e-8dee-3e54fd978d09" containerName="istio-proxy" Nov 04 07:41:24.811205 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.811019 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5eb6bbdd-461f-448e-8dee-3e54fd978d09" containerName="istio-proxy" Nov 04 07:41:24.811205 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.811032 5030 cpu_manager.go:414] "containerMap: removing container" podUID="83eac9c0-e44d-49c0-9448-f0034ee0b10f" containerName="istio-proxy" Nov 04 07:41:24.811205 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.811039 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="83eac9c0-e44d-49c0-9448-f0034ee0b10f" containerName="istio-proxy" Nov 04 07:41:24.811205 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.811053 5030 cpu_manager.go:414] "containerMap: removing container" podUID="a6a5a285-9b50-4a95-a7db-e920fc79d50a" containerName="maas-api" Nov 04 07:41:24.811205 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.811060 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a6a5a285-9b50-4a95-a7db-e920fc79d50a" containerName="maas-api" Nov 04 07:41:24.811205 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.811076 5030 cpu_manager.go:414] "containerMap: removing container" podUID="83eac9c0-e44d-49c0-9448-f0034ee0b10f" containerName="istio-proxy" Nov 04 07:41:24.811205 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.811083 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="83eac9c0-e44d-49c0-9448-f0034ee0b10f" containerName="istio-proxy" Nov 04 07:41:24.811205 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.811117 5030 cpu_manager.go:414] "containerMap: removing container" podUID="cf999862-2c2c-41ab-a950-a0935b6dec14" containerName="istio-proxy" Nov 04 07:41:24.811205 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.811124 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf999862-2c2c-41ab-a950-a0935b6dec14" containerName="istio-proxy" Nov 04 07:41:24.811205 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.811158 5030 cpu_manager.go:414] "containerMap: removing container" podUID="12690e98-f768-42db-a92a-cb1ce80bec42" containerName="istio-proxy" Nov 04 07:41:24.811205 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.811179 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="12690e98-f768-42db-a92a-cb1ce80bec42" containerName="istio-proxy" Nov 04 07:41:24.811205 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.811191 5030 cpu_manager.go:414] "containerMap: removing container" podUID="89f8ea73-a637-4f9b-bd7c-bee93b531406" containerName="istio-proxy" Nov 04 07:41:24.811205 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.811198 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="89f8ea73-a637-4f9b-bd7c-bee93b531406" containerName="istio-proxy" Nov 04 07:41:24.811604 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.811317 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="5eb6bbdd-461f-448e-8dee-3e54fd978d09" containerName="istio-proxy" Nov 04 07:41:24.811604 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.811327 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="83eac9c0-e44d-49c0-9448-f0034ee0b10f" containerName="istio-proxy" Nov 04 07:41:24.811604 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.811337 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="a6a5a285-9b50-4a95-a7db-e920fc79d50a" containerName="maas-api" Nov 04 07:41:24.811604 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.811347 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="83eac9c0-e44d-49c0-9448-f0034ee0b10f" containerName="istio-proxy" Nov 04 07:41:24.811604 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.811362 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="cf999862-2c2c-41ab-a950-a0935b6dec14" containerName="istio-proxy" Nov 04 07:41:24.811604 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.811373 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="12690e98-f768-42db-a92a-cb1ce80bec42" containerName="istio-proxy" Nov 04 07:41:24.811604 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.811382 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="89f8ea73-a637-4f9b-bd7c-bee93b531406" containerName="istio-proxy" Nov 04 07:41:24.811604 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.811395 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="416ca8a7-627c-428f-89fd-a7a55b7a8709" containerName="maas-api" Nov 04 07:41:24.816589 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.816566 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:24.829425 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.829404 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl"] Nov 04 07:41:24.889493 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.889467 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-29d3ee-openshift-default-dockercfg-xktsc\"" Nov 04 07:41:24.908057 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.908029 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-workload-certs\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:24.908192 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.908065 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-credential-socket\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:24.908192 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.908096 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-envoy\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:24.908306 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.908281 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-podinfo\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:24.908352 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.908319 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-data\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:24.908430 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.908416 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/878f8895-146b-4ac3-96b1-0d82f52f6697-istiod-ca-cert\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:24.908471 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.908455 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht456\" (UniqueName: \"kubernetes.io/projected/878f8895-146b-4ac3-96b1-0d82f52f6697-kube-api-access-ht456\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:24.908559 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.908545 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-workload-socket\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:24.908593 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:24.908568 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-token\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:25.009460 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.009429 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-podinfo\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:25.009587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.009464 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-data\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:25.009587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.009496 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/878f8895-146b-4ac3-96b1-0d82f52f6697-istiod-ca-cert\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:25.009587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.009532 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht456\" (UniqueName: \"kubernetes.io/projected/878f8895-146b-4ac3-96b1-0d82f52f6697-kube-api-access-ht456\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:25.009587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.009581 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-workload-socket\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:25.009862 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.009605 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-token\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:25.009862 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.009647 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-workload-certs\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:25.009862 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.009676 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-credential-socket\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:25.009862 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.009731 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-envoy\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:25.010044 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.009919 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-data\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:25.010182 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.010160 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-workload-certs\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:25.010268 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.010243 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-workload-socket\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:25.010363 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.010344 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-credential-socket\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:25.010420 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.010350 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/878f8895-146b-4ac3-96b1-0d82f52f6697-istiod-ca-cert\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:25.011920 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.011901 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-envoy\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:25.012169 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.012150 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-podinfo\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:25.021703 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.021678 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-token\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:25.021822 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.021765 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht456\" (UniqueName: \"kubernetes.io/projected/878f8895-146b-4ac3-96b1-0d82f52f6697-kube-api-access-ht456\") pod \"e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:25.135162 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.135084 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:25.422400 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.422368 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl"] Nov 04 07:41:25.422768 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:41:25.422742 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod878f8895_146b_4ac3_96b1_0d82f52f6697.slice/crio-c82165d69b586631be70860b0900a4ffdaedc106fb9e2267f5e1430392e03255 WatchSource:0}: Error finding container c82165d69b586631be70860b0900a4ffdaedc106fb9e2267f5e1430392e03255: Status 404 returned error can't find the container with id c82165d69b586631be70860b0900a4ffdaedc106fb9e2267f5e1430392e03255 Nov 04 07:41:25.425199 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.425166 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:41:25.425302 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.425243 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:41:25.425302 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.425288 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:41:25.725656 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.725555 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" event={"ID":"878f8895-146b-4ac3-96b1-0d82f52f6697","Type":"ContainerStarted","Data":"c015c10a4f414116a804ca00e0359239511885788fef2b79a78bd56fb34b3f8c"} Nov 04 07:41:25.725809 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.725658 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" event={"ID":"878f8895-146b-4ac3-96b1-0d82f52f6697","Type":"ContainerStarted","Data":"c82165d69b586631be70860b0900a4ffdaedc106fb9e2267f5e1430392e03255"} Nov 04 07:41:25.751610 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:25.751546 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" podStartSLOduration=1.751516649 podStartE2EDuration="1.751516649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:41:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:41:25.749202572 +0000 UTC m=+1559.731830832" watchObservedRunningTime="2026-11-04 07:41:25.751516649 +0000 UTC m=+1559.734144846" Nov 04 07:41:26.143595 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:26.143506 5030 patch_prober.go:29] interesting pod/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Nov 04 07:41:26.144189 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:26.144159 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" podUID="878f8895-146b-4ac3-96b1-0d82f52f6697" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Nov 04 07:41:26.150467 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:26.150440 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:27.136154 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:27.135521 5030 patch_prober.go:29] interesting pod/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Nov 04 07:41:27.136154 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:27.135582 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" podUID="878f8895-146b-4ac3-96b1-0d82f52f6697" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Nov 04 07:41:28.136155 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:28.135529 5030 patch_prober.go:29] interesting pod/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Nov 04 07:41:28.136155 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:28.135605 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" podUID="878f8895-146b-4ac3-96b1-0d82f52f6697" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Nov 04 07:41:29.142153 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:29.141631 5030 patch_prober.go:29] interesting pod/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Nov 04 07:41:29.142153 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:29.141688 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" podUID="878f8895-146b-4ac3-96b1-0d82f52f6697" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Nov 04 07:41:30.136153 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:30.135532 5030 patch_prober.go:29] interesting pod/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Nov 04 07:41:30.136153 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:30.135593 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" podUID="878f8895-146b-4ac3-96b1-0d82f52f6697" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Nov 04 07:41:31.135549 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:31.135506 5030 patch_prober.go:29] interesting pod/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Nov 04 07:41:31.136177 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:31.136106 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" podUID="878f8895-146b-4ac3-96b1-0d82f52f6697" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Nov 04 07:41:32.498156 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:32.497506 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:32.514152 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:32.499864 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:32.514152 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:32.500819 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:32.538096 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:32.537935 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl"] Nov 04 07:41:32.821384 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:32.821289 5030 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" secret="" err="secret \"e2e-worker-w1-29d3ee-openshift-default-dockercfg-xktsc\" not found" Nov 04 07:41:33.841215 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:33.841171 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" podUID="878f8895-146b-4ac3-96b1-0d82f52f6697" containerName="istio-proxy" containerID="cri-o://c015c10a4f414116a804ca00e0359239511885788fef2b79a78bd56fb34b3f8c" gracePeriod=30 Nov 04 07:41:36.568455 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:36.568415 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5"] Nov 04 07:41:36.568933 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:36.568697 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5" podUID="618777a4-9d04-40dc-abd7-6754b8e1c785" containerName="maas-api" containerID="cri-o://b9fe50fdc26b046454d9d3dd25ab83d7d49211393f6e21cbd3f0f9d2cd491d19" gracePeriod=30 Nov 04 07:41:36.901101 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:36.900922 5030 generic.go:356] "Generic (PLEG): container finished" podID="618777a4-9d04-40dc-abd7-6754b8e1c785" containerID="b9fe50fdc26b046454d9d3dd25ab83d7d49211393f6e21cbd3f0f9d2cd491d19" exitCode=0 Nov 04 07:41:36.901101 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:36.901003 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5" event={"ID":"618777a4-9d04-40dc-abd7-6754b8e1c785","Type":"ContainerDied","Data":"b9fe50fdc26b046454d9d3dd25ab83d7d49211393f6e21cbd3f0f9d2cd491d19"} Nov 04 07:41:36.953906 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:36.953879 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5" Nov 04 07:41:37.093502 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:37.093464 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/618777a4-9d04-40dc-abd7-6754b8e1c785-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/618777a4-9d04-40dc-abd7-6754b8e1c785-openshift-service-ca\") pod \"618777a4-9d04-40dc-abd7-6754b8e1c785\" (UID: \"618777a4-9d04-40dc-abd7-6754b8e1c785\") " Nov 04 07:41:37.093679 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:37.093512 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/618777a4-9d04-40dc-abd7-6754b8e1c785-kube-api-access-c2njc\" (UniqueName: \"kubernetes.io/projected/618777a4-9d04-40dc-abd7-6754b8e1c785-kube-api-access-c2njc\") pod \"618777a4-9d04-40dc-abd7-6754b8e1c785\" (UID: \"618777a4-9d04-40dc-abd7-6754b8e1c785\") " Nov 04 07:41:37.093679 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:37.093542 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/618777a4-9d04-40dc-abd7-6754b8e1c785-metrics-certs\" (UniqueName: \"kubernetes.io/secret/618777a4-9d04-40dc-abd7-6754b8e1c785-metrics-certs\") pod \"618777a4-9d04-40dc-abd7-6754b8e1c785\" (UID: \"618777a4-9d04-40dc-abd7-6754b8e1c785\") " Nov 04 07:41:37.093679 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:37.093654 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/618777a4-9d04-40dc-abd7-6754b8e1c785-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/618777a4-9d04-40dc-abd7-6754b8e1c785-maas-api-tls\") pod \"618777a4-9d04-40dc-abd7-6754b8e1c785\" (UID: \"618777a4-9d04-40dc-abd7-6754b8e1c785\") " Nov 04 07:41:37.093913 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:37.093878 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/618777a4-9d04-40dc-abd7-6754b8e1c785-openshift-service-ca" pod "618777a4-9d04-40dc-abd7-6754b8e1c785" (UID: "618777a4-9d04-40dc-abd7-6754b8e1c785"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 07:41:37.094044 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:37.094018 5030 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/618777a4-9d04-40dc-abd7-6754b8e1c785-openshift-service-ca\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:41:37.095653 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:37.095626 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/618777a4-9d04-40dc-abd7-6754b8e1c785-metrics-certs" pod "618777a4-9d04-40dc-abd7-6754b8e1c785" (UID: "618777a4-9d04-40dc-abd7-6754b8e1c785"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 07:41:37.095764 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:37.095713 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/618777a4-9d04-40dc-abd7-6754b8e1c785-kube-api-access-c2njc" pod "618777a4-9d04-40dc-abd7-6754b8e1c785" (UID: "618777a4-9d04-40dc-abd7-6754b8e1c785"). InnerVolumeSpecName "kube-api-access-c2njc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:41:37.095832 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:37.095780 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/618777a4-9d04-40dc-abd7-6754b8e1c785-maas-api-tls" pod "618777a4-9d04-40dc-abd7-6754b8e1c785" (UID: "618777a4-9d04-40dc-abd7-6754b8e1c785"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 07:41:37.195015 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:37.194985 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2njc\" (UniqueName: \"kubernetes.io/projected/618777a4-9d04-40dc-abd7-6754b8e1c785-kube-api-access-c2njc\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:41:37.195015 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:37.195013 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/618777a4-9d04-40dc-abd7-6754b8e1c785-metrics-certs\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:41:37.195015 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:37.195023 5030 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/618777a4-9d04-40dc-abd7-6754b8e1c785-maas-api-tls\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:41:37.908880 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:37.908851 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5" Nov 04 07:41:37.909287 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:37.908884 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5" event={"ID":"618777a4-9d04-40dc-abd7-6754b8e1c785","Type":"ContainerDied","Data":"c1cbafa57b9ce3503c5218b3ae3f003cc76f1bbf13f05a80d124d266332ce636"} Nov 04 07:41:37.909287 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:37.908943 5030 scope.go:122] "RemoveContainer" containerID="b9fe50fdc26b046454d9d3dd25ab83d7d49211393f6e21cbd3f0f9d2cd491d19" Nov 04 07:41:37.934030 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:37.934004 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5"] Nov 04 07:41:37.938027 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:37.938002 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-2a8c48-6cd95b8d4d-vwww5"] Nov 04 07:41:38.145403 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:38.145369 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="618777a4-9d04-40dc-abd7-6754b8e1c785" path="/var/lib/kubelet/pods/618777a4-9d04-40dc-abd7-6754b8e1c785/volumes" Nov 04 07:41:39.116945 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.116915 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:39.218373 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.218343 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/878f8895-146b-4ac3-96b1-0d82f52f6697-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/878f8895-146b-4ac3-96b1-0d82f52f6697-istiod-ca-cert\") pod \"878f8895-146b-4ac3-96b1-0d82f52f6697\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " Nov 04 07:41:39.218592 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.218426 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-credential-socket\") pod \"878f8895-146b-4ac3-96b1-0d82f52f6697\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " Nov 04 07:41:39.218592 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.218475 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-envoy\") pod \"878f8895-146b-4ac3-96b1-0d82f52f6697\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " Nov 04 07:41:39.218592 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.218509 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-podinfo\") pod \"878f8895-146b-4ac3-96b1-0d82f52f6697\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " Nov 04 07:41:39.218592 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.218562 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/878f8895-146b-4ac3-96b1-0d82f52f6697-kube-api-access-ht456\" (UniqueName: \"kubernetes.io/projected/878f8895-146b-4ac3-96b1-0d82f52f6697-kube-api-access-ht456\") pod \"878f8895-146b-4ac3-96b1-0d82f52f6697\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " Nov 04 07:41:39.218825 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.218599 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-token\" (UniqueName: \"kubernetes.io/projected/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-token\") pod \"878f8895-146b-4ac3-96b1-0d82f52f6697\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " Nov 04 07:41:39.218825 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.218673 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-data\") pod \"878f8895-146b-4ac3-96b1-0d82f52f6697\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " Nov 04 07:41:39.218825 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.218724 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-workload-certs\") pod \"878f8895-146b-4ac3-96b1-0d82f52f6697\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " Nov 04 07:41:39.218825 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.218763 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-credential-socket" pod "878f8895-146b-4ac3-96b1-0d82f52f6697" (UID: "878f8895-146b-4ac3-96b1-0d82f52f6697"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:41:39.218825 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.218784 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-workload-socket\") pod \"878f8895-146b-4ac3-96b1-0d82f52f6697\" (UID: \"878f8895-146b-4ac3-96b1-0d82f52f6697\") " Nov 04 07:41:39.219152 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.219013 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-data" pod "878f8895-146b-4ac3-96b1-0d82f52f6697" (UID: "878f8895-146b-4ac3-96b1-0d82f52f6697"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:41:39.219152 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.219056 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-workload-certs" pod "878f8895-146b-4ac3-96b1-0d82f52f6697" (UID: "878f8895-146b-4ac3-96b1-0d82f52f6697"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:41:39.219152 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.218771 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/878f8895-146b-4ac3-96b1-0d82f52f6697-istiod-ca-cert" pod "878f8895-146b-4ac3-96b1-0d82f52f6697" (UID: "878f8895-146b-4ac3-96b1-0d82f52f6697"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 07:41:39.219414 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.219306 5030 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-data\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:41:39.219414 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.219328 5030 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-workload-certs\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:41:39.219414 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.219329 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-workload-socket" pod "878f8895-146b-4ac3-96b1-0d82f52f6697" (UID: "878f8895-146b-4ac3-96b1-0d82f52f6697"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:41:39.219414 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.219343 5030 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/878f8895-146b-4ac3-96b1-0d82f52f6697-istiod-ca-cert\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:41:39.219414 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.219359 5030 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-credential-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:41:39.220958 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.220929 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/878f8895-146b-4ac3-96b1-0d82f52f6697-kube-api-access-ht456" pod "878f8895-146b-4ac3-96b1-0d82f52f6697" (UID: "878f8895-146b-4ac3-96b1-0d82f52f6697"). InnerVolumeSpecName "kube-api-access-ht456". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:41:39.221048 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.220976 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-envoy" pod "878f8895-146b-4ac3-96b1-0d82f52f6697" (UID: "878f8895-146b-4ac3-96b1-0d82f52f6697"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:41:39.221085 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.221060 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-token" pod "878f8895-146b-4ac3-96b1-0d82f52f6697" (UID: "878f8895-146b-4ac3-96b1-0d82f52f6697"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:41:39.221294 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.221277 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-podinfo" pod "878f8895-146b-4ac3-96b1-0d82f52f6697" (UID: "878f8895-146b-4ac3-96b1-0d82f52f6697"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 07:41:39.320838 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.320805 5030 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-podinfo\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:41:39.320951 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.320842 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht456\" (UniqueName: \"kubernetes.io/projected/878f8895-146b-4ac3-96b1-0d82f52f6697-kube-api-access-ht456\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:41:39.320951 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.320860 5030 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-token\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:41:39.320951 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.320873 5030 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-workload-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:41:39.320951 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.320888 5030 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/878f8895-146b-4ac3-96b1-0d82f52f6697-istio-envoy\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:41:39.923104 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.923072 5030 generic.go:356] "Generic (PLEG): container finished" podID="878f8895-146b-4ac3-96b1-0d82f52f6697" containerID="c015c10a4f414116a804ca00e0359239511885788fef2b79a78bd56fb34b3f8c" exitCode=0 Nov 04 07:41:39.923299 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.923148 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" event={"ID":"878f8895-146b-4ac3-96b1-0d82f52f6697","Type":"ContainerDied","Data":"c015c10a4f414116a804ca00e0359239511885788fef2b79a78bd56fb34b3f8c"} Nov 04 07:41:39.923299 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.923156 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" Nov 04 07:41:39.923299 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.923213 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl" event={"ID":"878f8895-146b-4ac3-96b1-0d82f52f6697","Type":"ContainerDied","Data":"c82165d69b586631be70860b0900a4ffdaedc106fb9e2267f5e1430392e03255"} Nov 04 07:41:39.923299 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.923234 5030 scope.go:122] "RemoveContainer" containerID="c015c10a4f414116a804ca00e0359239511885788fef2b79a78bd56fb34b3f8c" Nov 04 07:41:39.935926 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.935901 5030 scope.go:122] "RemoveContainer" containerID="c015c10a4f414116a804ca00e0359239511885788fef2b79a78bd56fb34b3f8c" Nov 04 07:41:39.936452 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:41:39.936429 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c015c10a4f414116a804ca00e0359239511885788fef2b79a78bd56fb34b3f8c\": container with ID starting with c015c10a4f414116a804ca00e0359239511885788fef2b79a78bd56fb34b3f8c not found: ID does not exist" containerID="c015c10a4f414116a804ca00e0359239511885788fef2b79a78bd56fb34b3f8c" Nov 04 07:41:39.936544 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.936464 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c015c10a4f414116a804ca00e0359239511885788fef2b79a78bd56fb34b3f8c"} err="failed to get container status \"c015c10a4f414116a804ca00e0359239511885788fef2b79a78bd56fb34b3f8c\": rpc error: code = NotFound desc = could not find container \"c015c10a4f414116a804ca00e0359239511885788fef2b79a78bd56fb34b3f8c\": container with ID starting with c015c10a4f414116a804ca00e0359239511885788fef2b79a78bd56fb34b3f8c not found: ID does not exist" Nov 04 07:41:39.956605 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.956578 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl"] Nov 04 07:41:39.961606 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:39.961585 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-29d3ee-openshift-default-844cdd95d7-4fgkl"] Nov 04 07:41:40.146345 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:40.146302 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="878f8895-146b-4ac3-96b1-0d82f52f6697" path="/var/lib/kubelet/pods/878f8895-146b-4ac3-96b1-0d82f52f6697/volumes" Nov 04 07:41:45.503570 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:41:45.503534 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:41:52.140336 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:41:52.140298 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:42:04.946177 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:04.946123 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs"] Nov 04 07:42:04.951290 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:04.951256 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc"] Nov 04 07:42:09.145565 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:09.145530 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:42:19.968099 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:19.968030 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" podUID="0b28a1b0-7560-46f8-b0af-03eb3a196958" containerName="main" containerID="cri-o://0cc73dc26fa1709f2492cc9c5e9acfc8031178de1bf9733416d73af770fb1b16" gracePeriod=45 Nov 04 07:42:19.976653 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:19.976617 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" podUID="6d707a40-b0a6-4c4d-a001-10536187e51c" containerName="main" containerID="cri-o://207046cc5a850c946e3683f972f207a93024eadbad0caf6a86bdc2362c94454e" gracePeriod=45 Nov 04 07:42:20.222257 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.222165 5030 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" podUID="6d707a40-b0a6-4c4d-a001-10536187e51c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.51:8000/ready\": dial tcp 10.132.0.51:8000: connect: connection refused" Nov 04 07:42:20.375796 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.375771 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:42:20.379791 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.379771 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:42:20.504944 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.504845 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-model-cache\") pod \"0b28a1b0-7560-46f8-b0af-03eb3a196958\" (UID: \"0b28a1b0-7560-46f8-b0af-03eb3a196958\") " Nov 04 07:42:20.505107 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.504951 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-home\" (UniqueName: \"kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-home\") pod \"0b28a1b0-7560-46f8-b0af-03eb3a196958\" (UID: \"0b28a1b0-7560-46f8-b0af-03eb3a196958\") " Nov 04 07:42:20.505107 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.504991 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-tmp-dir\") pod \"0b28a1b0-7560-46f8-b0af-03eb3a196958\" (UID: \"0b28a1b0-7560-46f8-b0af-03eb3a196958\") " Nov 04 07:42:20.505107 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.505019 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-dshm\") pod \"0b28a1b0-7560-46f8-b0af-03eb3a196958\" (UID: \"0b28a1b0-7560-46f8-b0af-03eb3a196958\") " Nov 04 07:42:20.505107 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.505061 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0b28a1b0-7560-46f8-b0af-03eb3a196958-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b28a1b0-7560-46f8-b0af-03eb3a196958-tls-certs\") pod \"0b28a1b0-7560-46f8-b0af-03eb3a196958\" (UID: \"0b28a1b0-7560-46f8-b0af-03eb3a196958\") " Nov 04 07:42:20.505107 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.505087 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6d707a40-b0a6-4c4d-a001-10536187e51c-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d707a40-b0a6-4c4d-a001-10536187e51c-tls-certs\") pod \"6d707a40-b0a6-4c4d-a001-10536187e51c\" (UID: \"6d707a40-b0a6-4c4d-a001-10536187e51c\") " Nov 04 07:42:20.505388 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.505225 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0b28a1b0-7560-46f8-b0af-03eb3a196958-kube-api-access-zv9f6\" (UniqueName: \"kubernetes.io/projected/0b28a1b0-7560-46f8-b0af-03eb3a196958-kube-api-access-zv9f6\") pod \"0b28a1b0-7560-46f8-b0af-03eb3a196958\" (UID: \"0b28a1b0-7560-46f8-b0af-03eb3a196958\") " Nov 04 07:42:20.505388 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.505260 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6d707a40-b0a6-4c4d-a001-10536187e51c-kube-api-access-fpqct\" (UniqueName: \"kubernetes.io/projected/6d707a40-b0a6-4c4d-a001-10536187e51c-kube-api-access-fpqct\") pod \"6d707a40-b0a6-4c4d-a001-10536187e51c\" (UID: \"6d707a40-b0a6-4c4d-a001-10536187e51c\") " Nov 04 07:42:20.505388 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.505303 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-dshm\") pod \"6d707a40-b0a6-4c4d-a001-10536187e51c\" (UID: \"6d707a40-b0a6-4c4d-a001-10536187e51c\") " Nov 04 07:42:20.505388 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.505343 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-model-cache\") pod \"6d707a40-b0a6-4c4d-a001-10536187e51c\" (UID: \"6d707a40-b0a6-4c4d-a001-10536187e51c\") " Nov 04 07:42:20.505388 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.505370 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-home\" (UniqueName: \"kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-home\") pod \"6d707a40-b0a6-4c4d-a001-10536187e51c\" (UID: \"6d707a40-b0a6-4c4d-a001-10536187e51c\") " Nov 04 07:42:20.505625 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.505452 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-tmp-dir\") pod \"6d707a40-b0a6-4c4d-a001-10536187e51c\" (UID: \"6d707a40-b0a6-4c4d-a001-10536187e51c\") " Nov 04 07:42:20.506577 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.506386 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-tmp-dir" pod "6d707a40-b0a6-4c4d-a001-10536187e51c" (UID: "6d707a40-b0a6-4c4d-a001-10536187e51c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:20.506701 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.506608 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-model-cache" pod "6d707a40-b0a6-4c4d-a001-10536187e51c" (UID: "6d707a40-b0a6-4c4d-a001-10536187e51c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:20.506924 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.506776 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-home" pod "6d707a40-b0a6-4c4d-a001-10536187e51c" (UID: "6d707a40-b0a6-4c4d-a001-10536187e51c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:20.510813 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.510443 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-tmp-dir" pod "0b28a1b0-7560-46f8-b0af-03eb3a196958" (UID: "0b28a1b0-7560-46f8-b0af-03eb3a196958"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:20.510813 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.510646 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-model-cache" pod "0b28a1b0-7560-46f8-b0af-03eb3a196958" (UID: "0b28a1b0-7560-46f8-b0af-03eb3a196958"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:20.510813 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.510769 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-home" pod "0b28a1b0-7560-46f8-b0af-03eb3a196958" (UID: "0b28a1b0-7560-46f8-b0af-03eb3a196958"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:20.548416 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.544963 5030 generic.go:356] "Generic (PLEG): container finished" podID="6d707a40-b0a6-4c4d-a001-10536187e51c" containerID="207046cc5a850c946e3683f972f207a93024eadbad0caf6a86bdc2362c94454e" exitCode=0 Nov 04 07:42:20.548416 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.545078 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" event={"ID":"6d707a40-b0a6-4c4d-a001-10536187e51c","Type":"ContainerDied","Data":"207046cc5a850c946e3683f972f207a93024eadbad0caf6a86bdc2362c94454e"} Nov 04 07:42:20.548416 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.545118 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" event={"ID":"6d707a40-b0a6-4c4d-a001-10536187e51c","Type":"ContainerDied","Data":"8e1b118831a8d8fa52d7ed90900bcda0ec1cec6ac1f80782325a86ffb1a5b3f5"} Nov 04 07:42:20.548416 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.545159 5030 scope.go:122] "RemoveContainer" containerID="207046cc5a850c946e3683f972f207a93024eadbad0caf6a86bdc2362c94454e" Nov 04 07:42:20.548416 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.545320 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc" Nov 04 07:42:20.558620 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.558119 5030 generic.go:356] "Generic (PLEG): container finished" podID="0b28a1b0-7560-46f8-b0af-03eb3a196958" containerID="0cc73dc26fa1709f2492cc9c5e9acfc8031178de1bf9733416d73af770fb1b16" exitCode=0 Nov 04 07:42:20.558620 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.558205 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" event={"ID":"0b28a1b0-7560-46f8-b0af-03eb3a196958","Type":"ContainerDied","Data":"0cc73dc26fa1709f2492cc9c5e9acfc8031178de1bf9733416d73af770fb1b16"} Nov 04 07:42:20.558620 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.558236 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" event={"ID":"0b28a1b0-7560-46f8-b0af-03eb3a196958","Type":"ContainerDied","Data":"89f96465b6d0bb54167eb8f0ebcf284bf2eb485c996119ab31c779affadcc106"} Nov 04 07:42:20.558620 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.558300 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs" Nov 04 07:42:20.564690 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.564638 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b28a1b0-7560-46f8-b0af-03eb3a196958-tls-certs" pod "0b28a1b0-7560-46f8-b0af-03eb3a196958" (UID: "0b28a1b0-7560-46f8-b0af-03eb3a196958"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 07:42:20.565206 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.565173 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b28a1b0-7560-46f8-b0af-03eb3a196958-kube-api-access-zv9f6" pod "0b28a1b0-7560-46f8-b0af-03eb3a196958" (UID: "0b28a1b0-7560-46f8-b0af-03eb3a196958"). InnerVolumeSpecName "kube-api-access-zv9f6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:42:20.565550 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.565511 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-dshm" pod "6d707a40-b0a6-4c4d-a001-10536187e51c" (UID: "6d707a40-b0a6-4c4d-a001-10536187e51c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:20.566063 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.566025 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d707a40-b0a6-4c4d-a001-10536187e51c-kube-api-access-fpqct" pod "6d707a40-b0a6-4c4d-a001-10536187e51c" (UID: "6d707a40-b0a6-4c4d-a001-10536187e51c"). InnerVolumeSpecName "kube-api-access-fpqct". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:42:20.566347 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.566297 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d707a40-b0a6-4c4d-a001-10536187e51c-tls-certs" pod "6d707a40-b0a6-4c4d-a001-10536187e51c" (UID: "6d707a40-b0a6-4c4d-a001-10536187e51c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 07:42:20.568389 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.568353 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-dshm" pod "0b28a1b0-7560-46f8-b0af-03eb3a196958" (UID: "0b28a1b0-7560-46f8-b0af-03eb3a196958"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:20.586352 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.586066 5030 scope.go:122] "RemoveContainer" containerID="207046cc5a850c946e3683f972f207a93024eadbad0caf6a86bdc2362c94454e" Nov 04 07:42:20.586847 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:42:20.586529 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"207046cc5a850c946e3683f972f207a93024eadbad0caf6a86bdc2362c94454e\": container with ID starting with 207046cc5a850c946e3683f972f207a93024eadbad0caf6a86bdc2362c94454e not found: ID does not exist" containerID="207046cc5a850c946e3683f972f207a93024eadbad0caf6a86bdc2362c94454e" Nov 04 07:42:20.586847 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.586564 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"207046cc5a850c946e3683f972f207a93024eadbad0caf6a86bdc2362c94454e"} err="failed to get container status \"207046cc5a850c946e3683f972f207a93024eadbad0caf6a86bdc2362c94454e\": rpc error: code = NotFound desc = could not find container \"207046cc5a850c946e3683f972f207a93024eadbad0caf6a86bdc2362c94454e\": container with ID starting with 207046cc5a850c946e3683f972f207a93024eadbad0caf6a86bdc2362c94454e not found: ID does not exist" Nov 04 07:42:20.586847 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.586589 5030 scope.go:122] "RemoveContainer" containerID="0cc73dc26fa1709f2492cc9c5e9acfc8031178de1bf9733416d73af770fb1b16" Nov 04 07:42:20.607292 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.607069 5030 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-home\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:20.607292 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.607100 5030 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-tmp-dir\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:20.607292 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.607115 5030 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-dshm\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:20.607292 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.607144 5030 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b28a1b0-7560-46f8-b0af-03eb3a196958-tls-certs\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:20.607292 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.607157 5030 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d707a40-b0a6-4c4d-a001-10536187e51c-tls-certs\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:20.607292 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.607169 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv9f6\" (UniqueName: \"kubernetes.io/projected/0b28a1b0-7560-46f8-b0af-03eb3a196958-kube-api-access-zv9f6\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:20.607292 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.607183 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpqct\" (UniqueName: \"kubernetes.io/projected/6d707a40-b0a6-4c4d-a001-10536187e51c-kube-api-access-fpqct\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:20.607292 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.607198 5030 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-dshm\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:20.607292 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.607211 5030 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-model-cache\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:20.607292 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.607223 5030 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-home\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:20.607292 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.607238 5030 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d707a40-b0a6-4c4d-a001-10536187e51c-tmp-dir\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:20.607292 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.607251 5030 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b28a1b0-7560-46f8-b0af-03eb3a196958-model-cache\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:20.620333 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.619913 5030 scope.go:122] "RemoveContainer" containerID="0cc73dc26fa1709f2492cc9c5e9acfc8031178de1bf9733416d73af770fb1b16" Nov 04 07:42:20.620333 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:42:20.620255 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cc73dc26fa1709f2492cc9c5e9acfc8031178de1bf9733416d73af770fb1b16\": container with ID starting with 0cc73dc26fa1709f2492cc9c5e9acfc8031178de1bf9733416d73af770fb1b16 not found: ID does not exist" containerID="0cc73dc26fa1709f2492cc9c5e9acfc8031178de1bf9733416d73af770fb1b16" Nov 04 07:42:20.620333 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.620289 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cc73dc26fa1709f2492cc9c5e9acfc8031178de1bf9733416d73af770fb1b16"} err="failed to get container status \"0cc73dc26fa1709f2492cc9c5e9acfc8031178de1bf9733416d73af770fb1b16\": rpc error: code = NotFound desc = could not find container \"0cc73dc26fa1709f2492cc9c5e9acfc8031178de1bf9733416d73af770fb1b16\": container with ID starting with 0cc73dc26fa1709f2492cc9c5e9acfc8031178de1bf9733416d73af770fb1b16 not found: ID does not exist" Nov 04 07:42:20.872000 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.871968 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc"] Nov 04 07:42:20.878227 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.878203 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-df3be8/premium-w0-df3be8-kserve-fc4d5649b-n4ncc"] Nov 04 07:42:20.892778 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.892753 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs"] Nov 04 07:42:20.899603 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:20.899576 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-df3be8/distinct-w0-df3be8-kserve-58d8bc7bb7-w6tqs"] Nov 04 07:42:22.144964 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:42:22.144908 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:42:22.147328 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:22.147252 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0b28a1b0-7560-46f8-b0af-03eb3a196958" path="/var/lib/kubelet/pods/0b28a1b0-7560-46f8-b0af-03eb3a196958/volumes" Nov 04 07:42:22.154225 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:22.147834 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6d707a40-b0a6-4c4d-a001-10536187e51c" path="/var/lib/kubelet/pods/6d707a40-b0a6-4c4d-a001-10536187e51c/volumes" Nov 04 07:42:26.217168 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:26.213538 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9"] Nov 04 07:42:26.217168 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:26.213746 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" podUID="795301b3-859d-4a1f-a960-e2dabf9ef43d" containerName="istio-proxy" containerID="cri-o://93d62d79b5598a8d03e0bb42ee02cd93f343052300958b3e2818efa5eda12b05" gracePeriod=30 Nov 04 07:42:26.244347 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:26.244313 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p"] Nov 04 07:42:26.244558 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:26.244530 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" podUID="b5aae1be-49b8-40dc-8caf-45420865f70b" containerName="istio-proxy" containerID="cri-o://a2486b2edd8afde205a994406b7123b84329058d50c79421c9f972d4415164d8" gracePeriod=30 Nov 04 07:42:26.264611 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:26.264586 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v"] Nov 04 07:42:26.265875 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:26.265039 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" podUID="7d486c29-06b1-4b0a-be57-d79b189ff66d" containerName="istio-proxy" containerID="cri-o://e1f6a2377c368a93d407ae594468d3b5390fb91ed9c6ba01093314932f5cd60e" gracePeriod=30 Nov 04 07:42:27.283036 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:27.283002 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:42:31.537848 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.537806 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:42:31.589542 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.589511 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:42:31.611768 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.611739 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:42:31.639167 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.637524 5030 generic.go:356] "Generic (PLEG): container finished" podID="b5aae1be-49b8-40dc-8caf-45420865f70b" containerID="a2486b2edd8afde205a994406b7123b84329058d50c79421c9f972d4415164d8" exitCode=0 Nov 04 07:42:31.639167 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.637600 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" Nov 04 07:42:31.639167 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.637633 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" event={"ID":"b5aae1be-49b8-40dc-8caf-45420865f70b","Type":"ContainerDied","Data":"a2486b2edd8afde205a994406b7123b84329058d50c79421c9f972d4415164d8"} Nov 04 07:42:31.639167 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.637711 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p" event={"ID":"b5aae1be-49b8-40dc-8caf-45420865f70b","Type":"ContainerDied","Data":"031de0ed9fa3b94c26dc921d0183e9830e490b8279b088f7472466e403c974dc"} Nov 04 07:42:31.639167 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.637828 5030 scope.go:122] "RemoveContainer" containerID="a2486b2edd8afde205a994406b7123b84329058d50c79421c9f972d4415164d8" Nov 04 07:42:31.640799 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.640768 5030 generic.go:356] "Generic (PLEG): container finished" podID="7d486c29-06b1-4b0a-be57-d79b189ff66d" containerID="e1f6a2377c368a93d407ae594468d3b5390fb91ed9c6ba01093314932f5cd60e" exitCode=0 Nov 04 07:42:31.640918 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.640882 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" event={"ID":"7d486c29-06b1-4b0a-be57-d79b189ff66d","Type":"ContainerDied","Data":"e1f6a2377c368a93d407ae594468d3b5390fb91ed9c6ba01093314932f5cd60e"} Nov 04 07:42:31.640982 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.640925 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" event={"ID":"7d486c29-06b1-4b0a-be57-d79b189ff66d","Type":"ContainerDied","Data":"7a342622ebcaa46f6dcdfe379476bca3415c566f1c36d3d8e4775ccb10f04a0f"} Nov 04 07:42:31.641039 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.641004 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v" Nov 04 07:42:31.643071 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.643042 5030 generic.go:356] "Generic (PLEG): container finished" podID="795301b3-859d-4a1f-a960-e2dabf9ef43d" containerID="93d62d79b5598a8d03e0bb42ee02cd93f343052300958b3e2818efa5eda12b05" exitCode=0 Nov 04 07:42:31.643199 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.643078 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" event={"ID":"795301b3-859d-4a1f-a960-e2dabf9ef43d","Type":"ContainerDied","Data":"93d62d79b5598a8d03e0bb42ee02cd93f343052300958b3e2818efa5eda12b05"} Nov 04 07:42:31.643199 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.643055 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" Nov 04 07:42:31.643199 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.643175 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9" event={"ID":"795301b3-859d-4a1f-a960-e2dabf9ef43d","Type":"ContainerDied","Data":"559c8cca2423c0658099c0c86aeb1756a34abc78345bef10afee5d19d91f037b"} Nov 04 07:42:31.650008 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.649987 5030 scope.go:122] "RemoveContainer" containerID="a2486b2edd8afde205a994406b7123b84329058d50c79421c9f972d4415164d8" Nov 04 07:42:31.650329 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:42:31.650310 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2486b2edd8afde205a994406b7123b84329058d50c79421c9f972d4415164d8\": container with ID starting with a2486b2edd8afde205a994406b7123b84329058d50c79421c9f972d4415164d8 not found: ID does not exist" containerID="a2486b2edd8afde205a994406b7123b84329058d50c79421c9f972d4415164d8" Nov 04 07:42:31.650418 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.650342 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2486b2edd8afde205a994406b7123b84329058d50c79421c9f972d4415164d8"} err="failed to get container status \"a2486b2edd8afde205a994406b7123b84329058d50c79421c9f972d4415164d8\": rpc error: code = NotFound desc = could not find container \"a2486b2edd8afde205a994406b7123b84329058d50c79421c9f972d4415164d8\": container with ID starting with a2486b2edd8afde205a994406b7123b84329058d50c79421c9f972d4415164d8 not found: ID does not exist" Nov 04 07:42:31.650418 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.650359 5030 scope.go:122] "RemoveContainer" containerID="e1f6a2377c368a93d407ae594468d3b5390fb91ed9c6ba01093314932f5cd60e" Nov 04 07:42:31.653753 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.653731 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-data\") pod \"795301b3-859d-4a1f-a960-e2dabf9ef43d\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " Nov 04 07:42:31.653854 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.653788 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-token\" (UniqueName: \"kubernetes.io/projected/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-token\") pod \"795301b3-859d-4a1f-a960-e2dabf9ef43d\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " Nov 04 07:42:31.653916 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.653886 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/795301b3-859d-4a1f-a960-e2dabf9ef43d-kube-api-access-cdtmp\" (UniqueName: \"kubernetes.io/projected/795301b3-859d-4a1f-a960-e2dabf9ef43d-kube-api-access-cdtmp\") pod \"795301b3-859d-4a1f-a960-e2dabf9ef43d\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " Nov 04 07:42:31.653972 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.653955 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-envoy\") pod \"795301b3-859d-4a1f-a960-e2dabf9ef43d\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " Nov 04 07:42:31.654027 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.653980 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-data" pod "795301b3-859d-4a1f-a960-e2dabf9ef43d" (UID: "795301b3-859d-4a1f-a960-e2dabf9ef43d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:31.654027 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.654019 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-credential-socket\") pod \"795301b3-859d-4a1f-a960-e2dabf9ef43d\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " Nov 04 07:42:31.654154 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.654088 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-workload-socket\") pod \"795301b3-859d-4a1f-a960-e2dabf9ef43d\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " Nov 04 07:42:31.654259 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.654221 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-workload-certs\") pod \"795301b3-859d-4a1f-a960-e2dabf9ef43d\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " Nov 04 07:42:31.654324 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.654251 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-podinfo\") pod \"795301b3-859d-4a1f-a960-e2dabf9ef43d\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " Nov 04 07:42:31.654377 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.654332 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/795301b3-859d-4a1f-a960-e2dabf9ef43d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/795301b3-859d-4a1f-a960-e2dabf9ef43d-istiod-ca-cert\") pod \"795301b3-859d-4a1f-a960-e2dabf9ef43d\" (UID: \"795301b3-859d-4a1f-a960-e2dabf9ef43d\") " Nov 04 07:42:31.654630 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.654562 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-workload-certs" pod "795301b3-859d-4a1f-a960-e2dabf9ef43d" (UID: "795301b3-859d-4a1f-a960-e2dabf9ef43d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:31.654782 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.654755 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-workload-socket" pod "795301b3-859d-4a1f-a960-e2dabf9ef43d" (UID: "795301b3-859d-4a1f-a960-e2dabf9ef43d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:31.654893 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.654869 5030 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-workload-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.654893 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.654884 5030 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-workload-certs\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.655014 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.654897 5030 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-data\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.655665 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.655478 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/795301b3-859d-4a1f-a960-e2dabf9ef43d-istiod-ca-cert" pod "795301b3-859d-4a1f-a960-e2dabf9ef43d" (UID: "795301b3-859d-4a1f-a960-e2dabf9ef43d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 07:42:31.655787 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.655763 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-credential-socket" pod "795301b3-859d-4a1f-a960-e2dabf9ef43d" (UID: "795301b3-859d-4a1f-a960-e2dabf9ef43d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:31.662054 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.662032 5030 scope.go:122] "RemoveContainer" containerID="e1f6a2377c368a93d407ae594468d3b5390fb91ed9c6ba01093314932f5cd60e" Nov 04 07:42:31.662365 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:42:31.662342 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1f6a2377c368a93d407ae594468d3b5390fb91ed9c6ba01093314932f5cd60e\": container with ID starting with e1f6a2377c368a93d407ae594468d3b5390fb91ed9c6ba01093314932f5cd60e not found: ID does not exist" containerID="e1f6a2377c368a93d407ae594468d3b5390fb91ed9c6ba01093314932f5cd60e" Nov 04 07:42:31.662442 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.662377 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1f6a2377c368a93d407ae594468d3b5390fb91ed9c6ba01093314932f5cd60e"} err="failed to get container status \"e1f6a2377c368a93d407ae594468d3b5390fb91ed9c6ba01093314932f5cd60e\": rpc error: code = NotFound desc = could not find container \"e1f6a2377c368a93d407ae594468d3b5390fb91ed9c6ba01093314932f5cd60e\": container with ID starting with e1f6a2377c368a93d407ae594468d3b5390fb91ed9c6ba01093314932f5cd60e not found: ID does not exist" Nov 04 07:42:31.662442 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.662399 5030 scope.go:122] "RemoveContainer" containerID="93d62d79b5598a8d03e0bb42ee02cd93f343052300958b3e2818efa5eda12b05" Nov 04 07:42:31.663920 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.663855 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/795301b3-859d-4a1f-a960-e2dabf9ef43d-kube-api-access-cdtmp" pod "795301b3-859d-4a1f-a960-e2dabf9ef43d" (UID: "795301b3-859d-4a1f-a960-e2dabf9ef43d"). InnerVolumeSpecName "kube-api-access-cdtmp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:42:31.664236 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.664215 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-envoy" pod "795301b3-859d-4a1f-a960-e2dabf9ef43d" (UID: "795301b3-859d-4a1f-a960-e2dabf9ef43d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:31.664945 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.664913 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-token" pod "795301b3-859d-4a1f-a960-e2dabf9ef43d" (UID: "795301b3-859d-4a1f-a960-e2dabf9ef43d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:42:31.665881 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.665836 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-podinfo" pod "795301b3-859d-4a1f-a960-e2dabf9ef43d" (UID: "795301b3-859d-4a1f-a960-e2dabf9ef43d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 07:42:31.672159 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.672115 5030 scope.go:122] "RemoveContainer" containerID="93d62d79b5598a8d03e0bb42ee02cd93f343052300958b3e2818efa5eda12b05" Nov 04 07:42:31.672454 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:42:31.672431 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93d62d79b5598a8d03e0bb42ee02cd93f343052300958b3e2818efa5eda12b05\": container with ID starting with 93d62d79b5598a8d03e0bb42ee02cd93f343052300958b3e2818efa5eda12b05 not found: ID does not exist" containerID="93d62d79b5598a8d03e0bb42ee02cd93f343052300958b3e2818efa5eda12b05" Nov 04 07:42:31.672555 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.672460 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93d62d79b5598a8d03e0bb42ee02cd93f343052300958b3e2818efa5eda12b05"} err="failed to get container status \"93d62d79b5598a8d03e0bb42ee02cd93f343052300958b3e2818efa5eda12b05\": rpc error: code = NotFound desc = could not find container \"93d62d79b5598a8d03e0bb42ee02cd93f343052300958b3e2818efa5eda12b05\": container with ID starting with 93d62d79b5598a8d03e0bb42ee02cd93f343052300958b3e2818efa5eda12b05 not found: ID does not exist" Nov 04 07:42:31.756004 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.755972 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-envoy\") pod \"7d486c29-06b1-4b0a-be57-d79b189ff66d\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " Nov 04 07:42:31.756251 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.756049 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-workload-certs\") pod \"7d486c29-06b1-4b0a-be57-d79b189ff66d\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " Nov 04 07:42:31.756251 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.756112 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-data\") pod \"b5aae1be-49b8-40dc-8caf-45420865f70b\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " Nov 04 07:42:31.756251 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.756195 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-envoy\") pod \"b5aae1be-49b8-40dc-8caf-45420865f70b\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " Nov 04 07:42:31.756251 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.756235 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-token\" (UniqueName: \"kubernetes.io/projected/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-token\") pod \"7d486c29-06b1-4b0a-be57-d79b189ff66d\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " Nov 04 07:42:31.756652 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.756276 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-workload-socket\") pod \"b5aae1be-49b8-40dc-8caf-45420865f70b\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " Nov 04 07:42:31.756652 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.756306 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-credential-socket\") pod \"7d486c29-06b1-4b0a-be57-d79b189ff66d\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " Nov 04 07:42:31.756652 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.756333 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-workload-socket\") pod \"7d486c29-06b1-4b0a-be57-d79b189ff66d\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " Nov 04 07:42:31.756652 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.756367 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-podinfo\") pod \"b5aae1be-49b8-40dc-8caf-45420865f70b\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " Nov 04 07:42:31.756652 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.756396 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-token\" (UniqueName: \"kubernetes.io/projected/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-token\") pod \"b5aae1be-49b8-40dc-8caf-45420865f70b\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " Nov 04 07:42:31.756652 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.756435 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b5aae1be-49b8-40dc-8caf-45420865f70b-kube-api-access-6fpf4\" (UniqueName: \"kubernetes.io/projected/b5aae1be-49b8-40dc-8caf-45420865f70b-kube-api-access-6fpf4\") pod \"b5aae1be-49b8-40dc-8caf-45420865f70b\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " Nov 04 07:42:31.756652 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.756466 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d486c29-06b1-4b0a-be57-d79b189ff66d-kube-api-access-ww9j7\" (UniqueName: \"kubernetes.io/projected/7d486c29-06b1-4b0a-be57-d79b189ff66d-kube-api-access-ww9j7\") pod \"7d486c29-06b1-4b0a-be57-d79b189ff66d\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " Nov 04 07:42:31.756652 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.756506 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-credential-socket\") pod \"b5aae1be-49b8-40dc-8caf-45420865f70b\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " Nov 04 07:42:31.756652 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.756502 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-data" pod "b5aae1be-49b8-40dc-8caf-45420865f70b" (UID: "b5aae1be-49b8-40dc-8caf-45420865f70b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:31.756652 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.756535 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-workload-certs\") pod \"b5aae1be-49b8-40dc-8caf-45420865f70b\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " Nov 04 07:42:31.757272 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.756727 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-credential-socket" pod "7d486c29-06b1-4b0a-be57-d79b189ff66d" (UID: "7d486c29-06b1-4b0a-be57-d79b189ff66d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:31.757272 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.756847 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-workload-certs" pod "b5aae1be-49b8-40dc-8caf-45420865f70b" (UID: "b5aae1be-49b8-40dc-8caf-45420865f70b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:31.757272 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.757198 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-workload-certs" pod "7d486c29-06b1-4b0a-be57-d79b189ff66d" (UID: "7d486c29-06b1-4b0a-be57-d79b189ff66d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:31.758587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.757622 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b5aae1be-49b8-40dc-8caf-45420865f70b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5aae1be-49b8-40dc-8caf-45420865f70b-istiod-ca-cert\") pod \"b5aae1be-49b8-40dc-8caf-45420865f70b\" (UID: \"b5aae1be-49b8-40dc-8caf-45420865f70b\") " Nov 04 07:42:31.758587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.757683 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-podinfo\") pod \"7d486c29-06b1-4b0a-be57-d79b189ff66d\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " Nov 04 07:42:31.758587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.757757 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-credential-socket" pod "b5aae1be-49b8-40dc-8caf-45420865f70b" (UID: "b5aae1be-49b8-40dc-8caf-45420865f70b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:31.758587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.757763 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7d486c29-06b1-4b0a-be57-d79b189ff66d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d486c29-06b1-4b0a-be57-d79b189ff66d-istiod-ca-cert\") pod \"7d486c29-06b1-4b0a-be57-d79b189ff66d\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " Nov 04 07:42:31.758587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.757821 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-data\") pod \"7d486c29-06b1-4b0a-be57-d79b189ff66d\" (UID: \"7d486c29-06b1-4b0a-be57-d79b189ff66d\") " Nov 04 07:42:31.758587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.758072 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d486c29-06b1-4b0a-be57-d79b189ff66d-istiod-ca-cert" pod "7d486c29-06b1-4b0a-be57-d79b189ff66d" (UID: "7d486c29-06b1-4b0a-be57-d79b189ff66d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 07:42:31.758587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.758298 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-workload-socket" pod "b5aae1be-49b8-40dc-8caf-45420865f70b" (UID: "b5aae1be-49b8-40dc-8caf-45420865f70b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:31.758587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.758418 5030 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-podinfo\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.758587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.758441 5030 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d486c29-06b1-4b0a-be57-d79b189ff66d-istiod-ca-cert\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.758587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.758455 5030 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/795301b3-859d-4a1f-a960-e2dabf9ef43d-istiod-ca-cert\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.758587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.758469 5030 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-token\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.758587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.758482 5030 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-workload-certs\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.758587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.758497 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdtmp\" (UniqueName: \"kubernetes.io/projected/795301b3-859d-4a1f-a960-e2dabf9ef43d-kube-api-access-cdtmp\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.758587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.758513 5030 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-istio-envoy\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.758587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.758528 5030 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-data\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.758587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.758543 5030 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/795301b3-859d-4a1f-a960-e2dabf9ef43d-credential-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.758587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.758559 5030 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-workload-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.758587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.758560 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-workload-socket" pod "7d486c29-06b1-4b0a-be57-d79b189ff66d" (UID: "7d486c29-06b1-4b0a-be57-d79b189ff66d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:31.758587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.758573 5030 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-credential-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.758587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.758588 5030 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-credential-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.758587 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.758603 5030 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-workload-certs\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.759651 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.758568 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5aae1be-49b8-40dc-8caf-45420865f70b-istiod-ca-cert" pod "b5aae1be-49b8-40dc-8caf-45420865f70b" (UID: "b5aae1be-49b8-40dc-8caf-45420865f70b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 07:42:31.759651 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.758619 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-data" pod "7d486c29-06b1-4b0a-be57-d79b189ff66d" (UID: "7d486c29-06b1-4b0a-be57-d79b189ff66d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:31.759651 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.759381 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5aae1be-49b8-40dc-8caf-45420865f70b-kube-api-access-6fpf4" pod "b5aae1be-49b8-40dc-8caf-45420865f70b" (UID: "b5aae1be-49b8-40dc-8caf-45420865f70b"). InnerVolumeSpecName "kube-api-access-6fpf4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:42:31.759651 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.759425 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-token" pod "b5aae1be-49b8-40dc-8caf-45420865f70b" (UID: "b5aae1be-49b8-40dc-8caf-45420865f70b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:42:31.761095 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.761068 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-token" pod "7d486c29-06b1-4b0a-be57-d79b189ff66d" (UID: "7d486c29-06b1-4b0a-be57-d79b189ff66d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:42:31.761185 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.761103 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-envoy" pod "b5aae1be-49b8-40dc-8caf-45420865f70b" (UID: "b5aae1be-49b8-40dc-8caf-45420865f70b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:31.761527 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.761502 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-envoy" pod "7d486c29-06b1-4b0a-be57-d79b189ff66d" (UID: "7d486c29-06b1-4b0a-be57-d79b189ff66d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:31.761638 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.761604 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-podinfo" pod "7d486c29-06b1-4b0a-be57-d79b189ff66d" (UID: "7d486c29-06b1-4b0a-be57-d79b189ff66d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 07:42:31.761705 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.761672 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d486c29-06b1-4b0a-be57-d79b189ff66d-kube-api-access-ww9j7" pod "7d486c29-06b1-4b0a-be57-d79b189ff66d" (UID: "7d486c29-06b1-4b0a-be57-d79b189ff66d"). InnerVolumeSpecName "kube-api-access-ww9j7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:42:31.763060 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.763042 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-podinfo" pod "b5aae1be-49b8-40dc-8caf-45420865f70b" (UID: "b5aae1be-49b8-40dc-8caf-45420865f70b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 07:42:31.859341 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.859277 5030 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-data\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.859341 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.859299 5030 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-envoy\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.859341 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.859309 5030 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-envoy\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.859341 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.859319 5030 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-token\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.859341 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.859327 5030 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d486c29-06b1-4b0a-be57-d79b189ff66d-workload-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.859341 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.859336 5030 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-podinfo\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.859341 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.859344 5030 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5aae1be-49b8-40dc-8caf-45420865f70b-istio-token\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.859604 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.859354 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fpf4\" (UniqueName: \"kubernetes.io/projected/b5aae1be-49b8-40dc-8caf-45420865f70b-kube-api-access-6fpf4\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.859604 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.859364 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ww9j7\" (UniqueName: \"kubernetes.io/projected/7d486c29-06b1-4b0a-be57-d79b189ff66d-kube-api-access-ww9j7\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.859604 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.859373 5030 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5aae1be-49b8-40dc-8caf-45420865f70b-istiod-ca-cert\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.859604 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.859382 5030 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d486c29-06b1-4b0a-be57-d79b189ff66d-istio-podinfo\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:31.963185 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.963159 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p"] Nov 04 07:42:31.967773 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.967751 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-bdh8p"] Nov 04 07:42:31.980163 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.980104 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v"] Nov 04 07:42:31.985522 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.985500 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-5tp6v"] Nov 04 07:42:31.997640 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:31.997616 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9"] Nov 04 07:42:32.002993 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.002973 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-016e6c-openshift-default-644bc689bc-nmcr9"] Nov 04 07:42:32.040713 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.040688 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9"] Nov 04 07:42:32.041115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.041102 5030 cpu_manager.go:414] "containerMap: removing container" podUID="618777a4-9d04-40dc-abd7-6754b8e1c785" containerName="maas-api" Nov 04 07:42:32.041180 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.041116 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="618777a4-9d04-40dc-abd7-6754b8e1c785" containerName="maas-api" Nov 04 07:42:32.041180 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.041148 5030 cpu_manager.go:414] "containerMap: removing container" podUID="6d707a40-b0a6-4c4d-a001-10536187e51c" containerName="main" Nov 04 07:42:32.041180 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.041153 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6d707a40-b0a6-4c4d-a001-10536187e51c" containerName="main" Nov 04 07:42:32.041180 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.041162 5030 cpu_manager.go:414] "containerMap: removing container" podUID="878f8895-146b-4ac3-96b1-0d82f52f6697" containerName="istio-proxy" Nov 04 07:42:32.041180 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.041166 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="878f8895-146b-4ac3-96b1-0d82f52f6697" containerName="istio-proxy" Nov 04 07:42:32.041180 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.041176 5030 cpu_manager.go:414] "containerMap: removing container" podUID="0b28a1b0-7560-46f8-b0af-03eb3a196958" containerName="main" Nov 04 07:42:32.041180 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.041181 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0b28a1b0-7560-46f8-b0af-03eb3a196958" containerName="main" Nov 04 07:42:32.041410 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.041188 5030 cpu_manager.go:414] "containerMap: removing container" podUID="b5aae1be-49b8-40dc-8caf-45420865f70b" containerName="istio-proxy" Nov 04 07:42:32.041410 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.041193 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b5aae1be-49b8-40dc-8caf-45420865f70b" containerName="istio-proxy" Nov 04 07:42:32.041410 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.041204 5030 cpu_manager.go:414] "containerMap: removing container" podUID="795301b3-859d-4a1f-a960-e2dabf9ef43d" containerName="istio-proxy" Nov 04 07:42:32.041410 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.041209 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="795301b3-859d-4a1f-a960-e2dabf9ef43d" containerName="istio-proxy" Nov 04 07:42:32.041410 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.041222 5030 cpu_manager.go:414] "containerMap: removing container" podUID="7d486c29-06b1-4b0a-be57-d79b189ff66d" containerName="istio-proxy" Nov 04 07:42:32.041410 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.041227 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d486c29-06b1-4b0a-be57-d79b189ff66d" containerName="istio-proxy" Nov 04 07:42:32.041410 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.041294 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d486c29-06b1-4b0a-be57-d79b189ff66d" containerName="istio-proxy" Nov 04 07:42:32.041410 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.041304 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="618777a4-9d04-40dc-abd7-6754b8e1c785" containerName="maas-api" Nov 04 07:42:32.041410 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.041310 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="6d707a40-b0a6-4c4d-a001-10536187e51c" containerName="main" Nov 04 07:42:32.041410 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.041316 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="795301b3-859d-4a1f-a960-e2dabf9ef43d" containerName="istio-proxy" Nov 04 07:42:32.041410 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.041322 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="878f8895-146b-4ac3-96b1-0d82f52f6697" containerName="istio-proxy" Nov 04 07:42:32.041410 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.041329 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="0b28a1b0-7560-46f8-b0af-03eb3a196958" containerName="main" Nov 04 07:42:32.041410 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.041334 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="b5aae1be-49b8-40dc-8caf-45420865f70b" containerName="istio-proxy" Nov 04 07:42:32.041410 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.041340 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="5eb6bbdd-461f-448e-8dee-3e54fd978d09" containerName="istio-proxy" Nov 04 07:42:32.046672 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.046654 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.067752 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.067723 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9"] Nov 04 07:42:32.082410 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.082386 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks"] Nov 04 07:42:32.086428 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.086409 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.112770 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.112708 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks"] Nov 04 07:42:32.144789 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.144756 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="795301b3-859d-4a1f-a960-e2dabf9ef43d" path="/var/lib/kubelet/pods/795301b3-859d-4a1f-a960-e2dabf9ef43d/volumes" Nov 04 07:42:32.146153 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.145692 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7d486c29-06b1-4b0a-be57-d79b189ff66d" path="/var/lib/kubelet/pods/7d486c29-06b1-4b0a-be57-d79b189ff66d/volumes" Nov 04 07:42:32.146953 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.146933 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b5aae1be-49b8-40dc-8caf-45420865f70b" path="/var/lib/kubelet/pods/b5aae1be-49b8-40dc-8caf-45420865f70b/volumes" Nov 04 07:42:32.163056 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.163031 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-workload-certs\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.163184 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.163074 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-envoy\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.163184 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.163096 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-workload-socket\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.163273 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.163253 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-token\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.163320 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.163282 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grgwr\" (UniqueName: \"kubernetes.io/projected/319e0009-e6ee-4ab1-8824-ed4e94acb449-kube-api-access-grgwr\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.163371 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.163320 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-podinfo\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.163371 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.163345 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/319e0009-e6ee-4ab1-8824-ed4e94acb449-istiod-ca-cert\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.163478 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.163463 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-credential-socket\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.163518 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.163496 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-data\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.264059 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.264029 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-data\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.264173 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.264065 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-token\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.264173 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.264089 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hnjb\" (UniqueName: \"kubernetes.io/projected/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-kube-api-access-8hnjb\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.264259 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.264194 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-workload-certs\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.264259 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.264231 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istiod-ca-cert\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.264328 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.264266 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-podinfo\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.264328 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.264283 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-envoy\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.264328 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.264302 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-workload-socket\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.264454 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.264425 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-data\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.264506 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.264477 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-token\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.264564 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.264516 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-data\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.264564 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.264548 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grgwr\" (UniqueName: \"kubernetes.io/projected/319e0009-e6ee-4ab1-8824-ed4e94acb449-kube-api-access-grgwr\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.264658 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.264561 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-workload-certs\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.264658 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.264607 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-workload-socket\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.264658 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.264625 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-podinfo\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.264658 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.264651 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-envoy\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.264857 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.264678 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-workload-socket\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.264857 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.264696 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-workload-certs\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.264857 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.264736 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/319e0009-e6ee-4ab1-8824-ed4e94acb449-istiod-ca-cert\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.265013 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.264895 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-credential-socket\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.265013 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.264932 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-credential-socket\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.265290 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.265264 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-credential-socket\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.265400 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.265366 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/319e0009-e6ee-4ab1-8824-ed4e94acb449-istiod-ca-cert\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.266520 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.266501 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-envoy\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.267005 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.266987 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-podinfo\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.276848 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.276826 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grgwr\" (UniqueName: \"kubernetes.io/projected/319e0009-e6ee-4ab1-8824-ed4e94acb449-kube-api-access-grgwr\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.277615 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.277595 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-token\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.360570 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.360540 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:32.366314 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.366289 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-envoy\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.366422 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.366327 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-workload-socket\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.366422 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.366349 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-workload-certs\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.366422 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.366376 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-credential-socket\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.367555 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.366424 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-token\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.367555 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.366463 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hnjb\" (UniqueName: \"kubernetes.io/projected/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-kube-api-access-8hnjb\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.367555 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.366515 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istiod-ca-cert\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.367555 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.366565 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-podinfo\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.367555 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.366610 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-data\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.367555 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.366751 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-workload-socket\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.367555 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.366795 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-workload-certs\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.367555 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.366975 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-data\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.367555 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.367335 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istiod-ca-cert\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.367555 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.367422 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-credential-socket\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.369082 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.369051 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-envoy\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.369217 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.369197 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-podinfo\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.378847 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.378824 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-token\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.379373 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.379350 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hnjb\" (UniqueName: \"kubernetes.io/projected/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-kube-api-access-8hnjb\") pod \"e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.411186 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.411126 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:32.657218 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.657189 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9"] Nov 04 07:42:32.658347 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:42:32.658319 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod319e0009_e6ee_4ab1_8824_ed4e94acb449.slice/crio-d70b6fe9f712c3f9714f5f8d6e8a5f944df46620594bbe144b52fdd13c9a8f9d WatchSource:0}: Error finding container d70b6fe9f712c3f9714f5f8d6e8a5f944df46620594bbe144b52fdd13c9a8f9d: Status 404 returned error can't find the container with id d70b6fe9f712c3f9714f5f8d6e8a5f944df46620594bbe144b52fdd13c9a8f9d Nov 04 07:42:32.660935 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.660902 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:42:32.661052 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.660977 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:42:32.661052 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.661021 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:42:32.715512 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.715479 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks"] Nov 04 07:42:32.717483 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:42:32.717454 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bfa3bff_cfdb_411a_b746_438a8cd8aaf3.slice/crio-d43d54bbe03a8dc88c3b13c4046b4c80d969cff708fe95b23bd4f5bb1f15d5cc WatchSource:0}: Error finding container d43d54bbe03a8dc88c3b13c4046b4c80d969cff708fe95b23bd4f5bb1f15d5cc: Status 404 returned error can't find the container with id d43d54bbe03a8dc88c3b13c4046b4c80d969cff708fe95b23bd4f5bb1f15d5cc Nov 04 07:42:32.719823 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.719795 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:42:32.719921 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.719855 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:42:32.719921 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:32.719883 5030 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236060Ki","pods":"250"} Nov 04 07:42:33.664860 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:33.664820 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" event={"ID":"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3","Type":"ContainerStarted","Data":"9e0acc3c624987cdbfb7e63973f83282bdde11994823f175ceb1d37519a5c9d7"} Nov 04 07:42:33.665366 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:33.664881 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" event={"ID":"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3","Type":"ContainerStarted","Data":"d43d54bbe03a8dc88c3b13c4046b4c80d969cff708fe95b23bd4f5bb1f15d5cc"} Nov 04 07:42:33.666731 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:33.666700 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" event={"ID":"319e0009-e6ee-4ab1-8824-ed4e94acb449","Type":"ContainerStarted","Data":"47468f72f372bfec2200dfbc35d794c44a2e2e23dd0a892e1362ab81a1084b6f"} Nov 04 07:42:33.666870 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:33.666751 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" event={"ID":"319e0009-e6ee-4ab1-8824-ed4e94acb449","Type":"ContainerStarted","Data":"d70b6fe9f712c3f9714f5f8d6e8a5f944df46620594bbe144b52fdd13c9a8f9d"} Nov 04 07:42:33.690197 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:33.690120 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" podStartSLOduration=1.69010291 podStartE2EDuration="1.69010291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:42:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:42:33.689463067 +0000 UTC m=+1627.672091261" watchObservedRunningTime="2026-11-04 07:42:33.69010291 +0000 UTC m=+1627.672731100" Nov 04 07:42:33.713950 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:33.713908 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" podStartSLOduration=1.713892842 podStartE2EDuration="1.713892842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 07:42:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:42:33.711780046 +0000 UTC m=+1627.694408240" watchObservedRunningTime="2026-11-04 07:42:33.713892842 +0000 UTC m=+1627.696521036" Nov 04 07:42:34.134155 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:34.127898 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:42:34.370158 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:34.368766 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:34.371288 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:34.371257 5030 patch_prober.go:29] interesting pod/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Nov 04 07:42:34.371449 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:34.371332 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" podUID="319e0009-e6ee-4ab1-8824-ed4e94acb449" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Nov 04 07:42:34.417247 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:34.412096 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:34.417547 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:34.417521 5030 patch_prober.go:29] interesting pod/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Nov 04 07:42:34.427153 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:34.417703 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" podUID="0bfa3bff-cfdb-411a-b746-438a8cd8aaf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Nov 04 07:42:35.363860 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:35.363469 5030 patch_prober.go:29] interesting pod/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Nov 04 07:42:35.363860 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:35.363518 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" podUID="319e0009-e6ee-4ab1-8824-ed4e94acb449" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Nov 04 07:42:35.411702 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:35.411672 5030 patch_prober.go:29] interesting pod/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Nov 04 07:42:35.411848 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:35.411719 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" podUID="0bfa3bff-cfdb-411a-b746-438a8cd8aaf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Nov 04 07:42:36.364157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:36.361517 5030 patch_prober.go:29] interesting pod/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Nov 04 07:42:36.364157 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:36.361575 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" podUID="319e0009-e6ee-4ab1-8824-ed4e94acb449" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Nov 04 07:42:36.411722 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:36.411692 5030 patch_prober.go:29] interesting pod/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Nov 04 07:42:36.411917 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:36.411895 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" podUID="0bfa3bff-cfdb-411a-b746-438a8cd8aaf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Nov 04 07:42:37.363611 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:37.363570 5030 patch_prober.go:29] interesting pod/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Nov 04 07:42:37.363904 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:37.363874 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" podUID="319e0009-e6ee-4ab1-8824-ed4e94acb449" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Nov 04 07:42:37.411760 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:37.411729 5030 patch_prober.go:29] interesting pod/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Nov 04 07:42:37.412235 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:37.411782 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" podUID="0bfa3bff-cfdb-411a-b746-438a8cd8aaf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Nov 04 07:42:38.361626 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:38.361590 5030 patch_prober.go:29] interesting pod/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Nov 04 07:42:38.361921 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:38.361886 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" podUID="319e0009-e6ee-4ab1-8824-ed4e94acb449" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Nov 04 07:42:38.411876 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:38.411842 5030 patch_prober.go:29] interesting pod/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Nov 04 07:42:38.412325 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:38.411887 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" podUID="0bfa3bff-cfdb-411a-b746-438a8cd8aaf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Nov 04 07:42:39.361477 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:39.361433 5030 patch_prober.go:29] interesting pod/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Nov 04 07:42:39.361698 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:39.361494 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" podUID="319e0009-e6ee-4ab1-8824-ed4e94acb449" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Nov 04 07:42:39.412322 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:39.412286 5030 patch_prober.go:29] interesting pod/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Nov 04 07:42:39.412779 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:39.412349 5030 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" podUID="0bfa3bff-cfdb-411a-b746-438a8cd8aaf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Nov 04 07:42:40.991154 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:40.990489 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:40.991628 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:40.991322 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:40.998187 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:40.997361 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:41.178205 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:41.178173 5030 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:41.178613 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:41.178587 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:41.179799 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:41.179775 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:44.591283 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:44.591249 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz"] Nov 04 07:42:44.592469 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:44.592395 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" podUID="be3e307f-5c30-440f-80d2-27e34f2f42b4" containerName="istio-proxy" containerID="cri-o://db7ffc72d5545015cb975c830dd8dd490976cdd75782cb1f26e5918356d18993" gracePeriod=30 Nov 04 07:42:44.594766 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:44.594740 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9"] Nov 04 07:42:44.594961 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:44.594924 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" podUID="319e0009-e6ee-4ab1-8824-ed4e94acb449" containerName="istio-proxy" containerID="cri-o://47468f72f372bfec2200dfbc35d794c44a2e2e23dd0a892e1362ab81a1084b6f" gracePeriod=30 Nov 04 07:42:44.609945 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:44.609916 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks"] Nov 04 07:42:44.610118 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:44.610099 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" podUID="0bfa3bff-cfdb-411a-b746-438a8cd8aaf3" containerName="istio-proxy" containerID="cri-o://9e0acc3c624987cdbfb7e63973f83282bdde11994823f175ceb1d37519a5c9d7" gracePeriod=30 Nov 04 07:42:45.316204 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:45.316165 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:42:49.825335 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:49.825296 5030 generic.go:356] "Generic (PLEG): container finished" podID="be3e307f-5c30-440f-80d2-27e34f2f42b4" containerID="db7ffc72d5545015cb975c830dd8dd490976cdd75782cb1f26e5918356d18993" exitCode=0 Nov 04 07:42:49.825804 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:49.825396 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" event={"ID":"be3e307f-5c30-440f-80d2-27e34f2f42b4","Type":"ContainerDied","Data":"db7ffc72d5545015cb975c830dd8dd490976cdd75782cb1f26e5918356d18993"} Nov 04 07:42:49.827281 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:49.827243 5030 generic.go:356] "Generic (PLEG): container finished" podID="0bfa3bff-cfdb-411a-b746-438a8cd8aaf3" containerID="9e0acc3c624987cdbfb7e63973f83282bdde11994823f175ceb1d37519a5c9d7" exitCode=0 Nov 04 07:42:49.827414 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:49.827324 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" event={"ID":"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3","Type":"ContainerDied","Data":"9e0acc3c624987cdbfb7e63973f83282bdde11994823f175ceb1d37519a5c9d7"} Nov 04 07:42:49.828919 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:49.828797 5030 generic.go:356] "Generic (PLEG): container finished" podID="319e0009-e6ee-4ab1-8824-ed4e94acb449" containerID="47468f72f372bfec2200dfbc35d794c44a2e2e23dd0a892e1362ab81a1084b6f" exitCode=0 Nov 04 07:42:49.828919 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:49.828857 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" event={"ID":"319e0009-e6ee-4ab1-8824-ed4e94acb449","Type":"ContainerDied","Data":"47468f72f372bfec2200dfbc35d794c44a2e2e23dd0a892e1362ab81a1084b6f"} Nov 04 07:42:49.904025 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:49.903998 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:42:49.913740 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:49.913717 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:49.946055 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:49.946026 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:50.052394 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.052356 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-podinfo\") pod \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " Nov 04 07:42:50.052663 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.052412 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-workload-certs\") pod \"be3e307f-5c30-440f-80d2-27e34f2f42b4\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " Nov 04 07:42:50.052663 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.052461 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-workload-certs\") pod \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " Nov 04 07:42:50.052663 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.052509 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-token\" (UniqueName: \"kubernetes.io/projected/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-token\") pod \"be3e307f-5c30-440f-80d2-27e34f2f42b4\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " Nov 04 07:42:50.052663 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.052537 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-workload-socket\") pod \"319e0009-e6ee-4ab1-8824-ed4e94acb449\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " Nov 04 07:42:50.052663 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.052564 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/319e0009-e6ee-4ab1-8824-ed4e94acb449-kube-api-access-grgwr\" (UniqueName: \"kubernetes.io/projected/319e0009-e6ee-4ab1-8824-ed4e94acb449-kube-api-access-grgwr\") pod \"319e0009-e6ee-4ab1-8824-ed4e94acb449\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " Nov 04 07:42:50.052663 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.052592 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-data\") pod \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " Nov 04 07:42:50.052663 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.052624 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-envoy\") pod \"319e0009-e6ee-4ab1-8824-ed4e94acb449\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " Nov 04 07:42:50.053462 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.053423 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-data" pod "0bfa3bff-cfdb-411a-b746-438a8cd8aaf3" (UID: "0bfa3bff-cfdb-411a-b746-438a8cd8aaf3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:50.053629 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.053441 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-workload-certs" pod "be3e307f-5c30-440f-80d2-27e34f2f42b4" (UID: "be3e307f-5c30-440f-80d2-27e34f2f42b4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:50.053754 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.053643 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-workload-certs" pod "0bfa3bff-cfdb-411a-b746-438a8cd8aaf3" (UID: "0bfa3bff-cfdb-411a-b746-438a8cd8aaf3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:50.053867 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.053842 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-data\") pod \"319e0009-e6ee-4ab1-8824-ed4e94acb449\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " Nov 04 07:42:50.053958 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.053893 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/319e0009-e6ee-4ab1-8824-ed4e94acb449-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/319e0009-e6ee-4ab1-8824-ed4e94acb449-istiod-ca-cert\") pod \"319e0009-e6ee-4ab1-8824-ed4e94acb449\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " Nov 04 07:42:50.053958 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.053934 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-kube-api-access-8hnjb\" (UniqueName: \"kubernetes.io/projected/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-kube-api-access-8hnjb\") pod \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " Nov 04 07:42:50.054054 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.053967 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-credential-socket\") pod \"be3e307f-5c30-440f-80d2-27e34f2f42b4\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " Nov 04 07:42:50.054054 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.054002 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-envoy\") pod \"be3e307f-5c30-440f-80d2-27e34f2f42b4\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " Nov 04 07:42:50.054054 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.054028 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-token\" (UniqueName: \"kubernetes.io/projected/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-token\") pod \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " Nov 04 07:42:50.054202 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.054062 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-podinfo\") pod \"be3e307f-5c30-440f-80d2-27e34f2f42b4\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " Nov 04 07:42:50.054202 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.054111 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-workload-certs\") pod \"319e0009-e6ee-4ab1-8824-ed4e94acb449\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " Nov 04 07:42:50.054202 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.054159 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-podinfo\") pod \"319e0009-e6ee-4ab1-8824-ed4e94acb449\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " Nov 04 07:42:50.054360 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.054220 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-credential-socket\") pod \"319e0009-e6ee-4ab1-8824-ed4e94acb449\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " Nov 04 07:42:50.054360 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.054295 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-workload-socket\") pod \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " Nov 04 07:42:50.054461 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.054376 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-credential-socket\") pod \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " Nov 04 07:42:50.054461 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.054407 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/be3e307f-5c30-440f-80d2-27e34f2f42b4-kube-api-access-njgf9\" (UniqueName: \"kubernetes.io/projected/be3e307f-5c30-440f-80d2-27e34f2f42b4-kube-api-access-njgf9\") pod \"be3e307f-5c30-440f-80d2-27e34f2f42b4\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " Nov 04 07:42:50.054461 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.054446 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/be3e307f-5c30-440f-80d2-27e34f2f42b4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be3e307f-5c30-440f-80d2-27e34f2f42b4-istiod-ca-cert\") pod \"be3e307f-5c30-440f-80d2-27e34f2f42b4\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " Nov 04 07:42:50.054622 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.054487 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istiod-ca-cert\") pod \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " Nov 04 07:42:50.054622 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.054517 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-workload-socket\") pod \"be3e307f-5c30-440f-80d2-27e34f2f42b4\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " Nov 04 07:42:50.055886 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.055082 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-envoy\") pod \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\" (UID: \"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3\") " Nov 04 07:42:50.055886 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.053638 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-workload-socket" pod "319e0009-e6ee-4ab1-8824-ed4e94acb449" (UID: "319e0009-e6ee-4ab1-8824-ed4e94acb449"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:50.055886 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.055152 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-data\") pod \"be3e307f-5c30-440f-80d2-27e34f2f42b4\" (UID: \"be3e307f-5c30-440f-80d2-27e34f2f42b4\") " Nov 04 07:42:50.055886 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.055188 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-token\" (UniqueName: \"kubernetes.io/projected/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-token\") pod \"319e0009-e6ee-4ab1-8824-ed4e94acb449\" (UID: \"319e0009-e6ee-4ab1-8824-ed4e94acb449\") " Nov 04 07:42:50.055886 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.055639 5030 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-workload-certs\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.055886 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.055661 5030 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-workload-certs\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.055886 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.055678 5030 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-workload-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.055886 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.055693 5030 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-data\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.056903 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.054372 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-data" pod "319e0009-e6ee-4ab1-8824-ed4e94acb449" (UID: "319e0009-e6ee-4ab1-8824-ed4e94acb449"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:50.056987 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.054745 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-workload-socket" pod "0bfa3bff-cfdb-411a-b746-438a8cd8aaf3" (UID: "0bfa3bff-cfdb-411a-b746-438a8cd8aaf3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:50.056987 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.056909 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-credential-socket" pod "319e0009-e6ee-4ab1-8824-ed4e94acb449" (UID: "319e0009-e6ee-4ab1-8824-ed4e94acb449"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:50.056987 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.055356 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-credential-socket" pod "0bfa3bff-cfdb-411a-b746-438a8cd8aaf3" (UID: "0bfa3bff-cfdb-411a-b746-438a8cd8aaf3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:50.056987 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.055370 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istiod-ca-cert" pod "0bfa3bff-cfdb-411a-b746-438a8cd8aaf3" (UID: "0bfa3bff-cfdb-411a-b746-438a8cd8aaf3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 07:42:50.056987 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.055527 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/319e0009-e6ee-4ab1-8824-ed4e94acb449-istiod-ca-cert" pod "319e0009-e6ee-4ab1-8824-ed4e94acb449" (UID: "319e0009-e6ee-4ab1-8824-ed4e94acb449"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 07:42:50.056987 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.055645 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-credential-socket" pod "be3e307f-5c30-440f-80d2-27e34f2f42b4" (UID: "be3e307f-5c30-440f-80d2-27e34f2f42b4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:50.056987 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.056297 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be3e307f-5c30-440f-80d2-27e34f2f42b4-istiod-ca-cert" pod "be3e307f-5c30-440f-80d2-27e34f2f42b4" (UID: "be3e307f-5c30-440f-80d2-27e34f2f42b4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 07:42:50.056987 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.056631 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-workload-socket" pod "be3e307f-5c30-440f-80d2-27e34f2f42b4" (UID: "be3e307f-5c30-440f-80d2-27e34f2f42b4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:50.056987 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.056713 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-token" pod "0bfa3bff-cfdb-411a-b746-438a8cd8aaf3" (UID: "0bfa3bff-cfdb-411a-b746-438a8cd8aaf3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:42:50.057478 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.057069 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-data" pod "be3e307f-5c30-440f-80d2-27e34f2f42b4" (UID: "be3e307f-5c30-440f-80d2-27e34f2f42b4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:50.057478 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.057094 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-workload-certs" pod "319e0009-e6ee-4ab1-8824-ed4e94acb449" (UID: "319e0009-e6ee-4ab1-8824-ed4e94acb449"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:50.058947 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.058922 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-podinfo" pod "319e0009-e6ee-4ab1-8824-ed4e94acb449" (UID: "319e0009-e6ee-4ab1-8824-ed4e94acb449"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 07:42:50.059326 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.059280 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-envoy" pod "be3e307f-5c30-440f-80d2-27e34f2f42b4" (UID: "be3e307f-5c30-440f-80d2-27e34f2f42b4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:50.059326 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.059291 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-envoy" pod "0bfa3bff-cfdb-411a-b746-438a8cd8aaf3" (UID: "0bfa3bff-cfdb-411a-b746-438a8cd8aaf3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:50.059488 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.059320 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/319e0009-e6ee-4ab1-8824-ed4e94acb449-kube-api-access-grgwr" pod "319e0009-e6ee-4ab1-8824-ed4e94acb449" (UID: "319e0009-e6ee-4ab1-8824-ed4e94acb449"). InnerVolumeSpecName "kube-api-access-grgwr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:42:50.059576 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.059556 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be3e307f-5c30-440f-80d2-27e34f2f42b4-kube-api-access-njgf9" pod "be3e307f-5c30-440f-80d2-27e34f2f42b4" (UID: "be3e307f-5c30-440f-80d2-27e34f2f42b4"). InnerVolumeSpecName "kube-api-access-njgf9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:42:50.059775 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.059757 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-podinfo" pod "be3e307f-5c30-440f-80d2-27e34f2f42b4" (UID: "be3e307f-5c30-440f-80d2-27e34f2f42b4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 07:42:50.061010 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.060974 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-kube-api-access-8hnjb" pod "0bfa3bff-cfdb-411a-b746-438a8cd8aaf3" (UID: "0bfa3bff-cfdb-411a-b746-438a8cd8aaf3"). InnerVolumeSpecName "kube-api-access-8hnjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:42:50.061097 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.061057 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-envoy" pod "319e0009-e6ee-4ab1-8824-ed4e94acb449" (UID: "319e0009-e6ee-4ab1-8824-ed4e94acb449"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:42:50.061097 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.061082 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-token" pod "319e0009-e6ee-4ab1-8824-ed4e94acb449" (UID: "319e0009-e6ee-4ab1-8824-ed4e94acb449"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:42:50.061261 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.061240 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-podinfo" pod "0bfa3bff-cfdb-411a-b746-438a8cd8aaf3" (UID: "0bfa3bff-cfdb-411a-b746-438a8cd8aaf3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 07:42:50.062827 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.062806 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-token" pod "be3e307f-5c30-440f-80d2-27e34f2f42b4" (UID: "be3e307f-5c30-440f-80d2-27e34f2f42b4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:42:50.156734 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.156702 5030 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-credential-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.156734 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.156733 5030 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-workload-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.156917 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.156748 5030 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-credential-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.156917 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.156760 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njgf9\" (UniqueName: \"kubernetes.io/projected/be3e307f-5c30-440f-80d2-27e34f2f42b4-kube-api-access-njgf9\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.156917 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.156774 5030 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be3e307f-5c30-440f-80d2-27e34f2f42b4-istiod-ca-cert\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.156917 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.156788 5030 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istiod-ca-cert\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.156917 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.156800 5030 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-workload-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.156917 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.156812 5030 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-envoy\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.156917 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.156824 5030 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-data\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.156917 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.156836 5030 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-token\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.156917 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.156848 5030 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-podinfo\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.156917 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.156863 5030 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-token\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.156917 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.156879 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grgwr\" (UniqueName: \"kubernetes.io/projected/319e0009-e6ee-4ab1-8824-ed4e94acb449-kube-api-access-grgwr\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.156917 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.156892 5030 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-envoy\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.156917 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.156907 5030 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-data\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.156917 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.156920 5030 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/319e0009-e6ee-4ab1-8824-ed4e94acb449-istiod-ca-cert\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.157407 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.156933 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hnjb\" (UniqueName: \"kubernetes.io/projected/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-kube-api-access-8hnjb\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.157407 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.156947 5030 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-credential-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.157407 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.156961 5030 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-envoy\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.157407 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.156975 5030 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3-istio-token\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.157407 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.156988 5030 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be3e307f-5c30-440f-80d2-27e34f2f42b4-istio-podinfo\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.157407 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.157002 5030 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/319e0009-e6ee-4ab1-8824-ed4e94acb449-workload-certs\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.157407 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.157016 5030 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/319e0009-e6ee-4ab1-8824-ed4e94acb449-istio-podinfo\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:42:50.835295 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.835262 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" Nov 04 07:42:50.835735 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.835265 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9" event={"ID":"319e0009-e6ee-4ab1-8824-ed4e94acb449","Type":"ContainerDied","Data":"d70b6fe9f712c3f9714f5f8d6e8a5f944df46620594bbe144b52fdd13c9a8f9d"} Nov 04 07:42:50.835735 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.835420 5030 scope.go:122] "RemoveContainer" containerID="47468f72f372bfec2200dfbc35d794c44a2e2e23dd0a892e1362ab81a1084b6f" Nov 04 07:42:50.837023 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.837002 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" Nov 04 07:42:50.837023 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.837009 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz" event={"ID":"be3e307f-5c30-440f-80d2-27e34f2f42b4","Type":"ContainerDied","Data":"6301ce17525baf680f4ea37b096d7249e92ec600fa3c628d9c9944bb330e85b0"} Nov 04 07:42:50.838781 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.838720 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" Nov 04 07:42:50.838781 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.838753 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks" event={"ID":"0bfa3bff-cfdb-411a-b746-438a8cd8aaf3","Type":"ContainerDied","Data":"d43d54bbe03a8dc88c3b13c4046b4c80d969cff708fe95b23bd4f5bb1f15d5cc"} Nov 04 07:42:50.847493 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.847478 5030 scope.go:122] "RemoveContainer" containerID="db7ffc72d5545015cb975c830dd8dd490976cdd75782cb1f26e5918356d18993" Nov 04 07:42:50.855939 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.855920 5030 scope.go:122] "RemoveContainer" containerID="9e0acc3c624987cdbfb7e63973f83282bdde11994823f175ceb1d37519a5c9d7" Nov 04 07:42:50.870090 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.870069 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz"] Nov 04 07:42:50.874420 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.874373 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-gc9tz"] Nov 04 07:42:50.889288 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.889267 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9"] Nov 04 07:42:50.894933 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.894913 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-fxwv9"] Nov 04 07:42:50.908008 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.907989 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks"] Nov 04 07:42:50.914142 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:50.914117 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-df3be8-openshift-default-854766f5d9-f85ks"] Nov 04 07:42:52.139927 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:42:52.139890 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:42:52.144424 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:52.144398 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0bfa3bff-cfdb-411a-b746-438a8cd8aaf3" path="/var/lib/kubelet/pods/0bfa3bff-cfdb-411a-b746-438a8cd8aaf3/volumes" Nov 04 07:42:52.144815 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:52.144801 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="319e0009-e6ee-4ab1-8824-ed4e94acb449" path="/var/lib/kubelet/pods/319e0009-e6ee-4ab1-8824-ed4e94acb449/volumes" Nov 04 07:42:52.145206 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:52.145192 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="be3e307f-5c30-440f-80d2-27e34f2f42b4" path="/var/lib/kubelet/pods/be3e307f-5c30-440f-80d2-27e34f2f42b4/volumes" Nov 04 07:42:54.230437 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:54.230403 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:42:59.022775 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:42:59.022741 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-z9lc6"] Nov 04 07:43:15.142264 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:15.142047 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g"] Nov 04 07:43:15.142844 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:15.142327 5030 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" podUID="e155c8ba-0187-49e8-b9fd-228502823f6b" containerName="istio-proxy" containerID="cri-o://3573923df5a55b4143b971a464b7312d74b9ca0af2f77cf0b9928a878e8b0fe2" gracePeriod=30 Nov 04 07:43:16.390366 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:16.390336 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-fmj2k_4a95000c-9422-41b9-83e9-659fc26dfaa6/manager/0.log" Nov 04 07:43:16.585649 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:16.585613 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-jtwwh_31939c31-8295-4fba-8811-96765f243312/manager/0.log" Nov 04 07:43:16.765578 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:16.765546 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-xwnp7_e2956fe2-f38a-4d14-8973-00f8ec02a0fb/kuadrant-console-plugin/0.log" Nov 04 07:43:17.222701 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:17.222662 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-sqpgg_4139aec4-ab58-4f94-b036-3475c0c8d459/manager/0.log" Nov 04 07:43:17.438850 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:17.438816 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-z9lc6_bad7bc32-bbd4-41c7-8fc5-04ca96400ce1/limitador/0.log" Nov 04 07:43:17.616432 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:17.616364 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-4c2q5_92015ad5-dc71-4822-beac-d8a06dc412dc/manager/0.log" Nov 04 07:43:19.091616 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:19.091584 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-pw7r7_734fadd0-bd20-46bd-bbca-0bebc35db24d/manager/0.log" Nov 04 07:43:19.771675 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:19.771624 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-mcg7w_41781aaa-b723-4863-928f-6a0925384d73/manager/0.log" Nov 04 07:43:20.393321 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.393292 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:43:20.418591 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.418560 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-workload-socket\") pod \"e155c8ba-0187-49e8-b9fd-228502823f6b\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " Nov 04 07:43:20.418716 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.418665 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-credential-socket\") pod \"e155c8ba-0187-49e8-b9fd-228502823f6b\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " Nov 04 07:43:20.418780 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.418713 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-workload-certs\") pod \"e155c8ba-0187-49e8-b9fd-228502823f6b\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " Nov 04 07:43:20.418780 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.418743 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-token\" (UniqueName: \"kubernetes.io/projected/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-token\") pod \"e155c8ba-0187-49e8-b9fd-228502823f6b\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " Nov 04 07:43:20.418892 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.418803 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-workload-socket" pod "e155c8ba-0187-49e8-b9fd-228502823f6b" (UID: "e155c8ba-0187-49e8-b9fd-228502823f6b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:43:20.418892 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.418829 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e155c8ba-0187-49e8-b9fd-228502823f6b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e155c8ba-0187-49e8-b9fd-228502823f6b-istiod-ca-cert\") pod \"e155c8ba-0187-49e8-b9fd-228502823f6b\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " Nov 04 07:43:20.418892 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.418867 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-data\") pod \"e155c8ba-0187-49e8-b9fd-228502823f6b\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " Nov 04 07:43:20.418892 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.418889 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e155c8ba-0187-49e8-b9fd-228502823f6b-kube-api-access-w9pbd\" (UniqueName: \"kubernetes.io/projected/e155c8ba-0187-49e8-b9fd-228502823f6b-kube-api-access-w9pbd\") pod \"e155c8ba-0187-49e8-b9fd-228502823f6b\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " Nov 04 07:43:20.419115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.418986 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-credential-socket" pod "e155c8ba-0187-49e8-b9fd-228502823f6b" (UID: "e155c8ba-0187-49e8-b9fd-228502823f6b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:43:20.419115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.419047 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-workload-certs" pod "e155c8ba-0187-49e8-b9fd-228502823f6b" (UID: "e155c8ba-0187-49e8-b9fd-228502823f6b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:43:20.419115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.419058 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-envoy\") pod \"e155c8ba-0187-49e8-b9fd-228502823f6b\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " Nov 04 07:43:20.419115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.419094 5030 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-podinfo\") pod \"e155c8ba-0187-49e8-b9fd-228502823f6b\" (UID: \"e155c8ba-0187-49e8-b9fd-228502823f6b\") " Nov 04 07:43:20.419426 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.419240 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e155c8ba-0187-49e8-b9fd-228502823f6b-istiod-ca-cert" pod "e155c8ba-0187-49e8-b9fd-228502823f6b" (UID: "e155c8ba-0187-49e8-b9fd-228502823f6b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 07:43:20.420375 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.419560 5030 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e155c8ba-0187-49e8-b9fd-228502823f6b-istiod-ca-cert\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:43:20.420375 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.419586 5030 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-workload-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:43:20.420375 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.419622 5030 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-credential-socket\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:43:20.420375 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.419636 5030 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-workload-certs\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:43:20.420375 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.420340 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-data" pod "e155c8ba-0187-49e8-b9fd-228502823f6b" (UID: "e155c8ba-0187-49e8-b9fd-228502823f6b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:43:20.422502 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.422392 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e155c8ba-0187-49e8-b9fd-228502823f6b-kube-api-access-w9pbd" pod "e155c8ba-0187-49e8-b9fd-228502823f6b" (UID: "e155c8ba-0187-49e8-b9fd-228502823f6b"). InnerVolumeSpecName "kube-api-access-w9pbd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:43:20.422502 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.422454 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-envoy" pod "e155c8ba-0187-49e8-b9fd-228502823f6b" (UID: "e155c8ba-0187-49e8-b9fd-228502823f6b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 07:43:20.422502 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.422461 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-token" pod "e155c8ba-0187-49e8-b9fd-228502823f6b" (UID: "e155c8ba-0187-49e8-b9fd-228502823f6b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 07:43:20.423249 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.423213 5030 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-podinfo" pod "e155c8ba-0187-49e8-b9fd-228502823f6b" (UID: "e155c8ba-0187-49e8-b9fd-228502823f6b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 07:43:20.520348 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.520321 5030 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-token\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:43:20.520348 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.520345 5030 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-data\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:43:20.520486 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.520356 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9pbd\" (UniqueName: \"kubernetes.io/projected/e155c8ba-0187-49e8-b9fd-228502823f6b-kube-api-access-w9pbd\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:43:20.520486 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.520368 5030 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-envoy\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:43:20.520486 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:20.520376 5030 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e155c8ba-0187-49e8-b9fd-228502823f6b-istio-podinfo\") on node \"ip-10-0-130-91.us-east-2.compute.internal\" DevicePath \"\"" Nov 04 07:43:21.010441 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:21.010407 5030 generic.go:356] "Generic (PLEG): container finished" podID="e155c8ba-0187-49e8-b9fd-228502823f6b" containerID="3573923df5a55b4143b971a464b7312d74b9ca0af2f77cf0b9928a878e8b0fe2" exitCode=0 Nov 04 07:43:21.010617 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:21.010452 5030 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" Nov 04 07:43:21.010617 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:21.010456 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" event={"ID":"e155c8ba-0187-49e8-b9fd-228502823f6b","Type":"ContainerDied","Data":"3573923df5a55b4143b971a464b7312d74b9ca0af2f77cf0b9928a878e8b0fe2"} Nov 04 07:43:21.010617 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:21.010585 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g" event={"ID":"e155c8ba-0187-49e8-b9fd-228502823f6b","Type":"ContainerDied","Data":"ce0d24457defe23d2801cc3e047c4d5fb4885e398e3f58b0e0bcddc5806aa3e1"} Nov 04 07:43:21.010785 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:21.010620 5030 scope.go:122] "RemoveContainer" containerID="3573923df5a55b4143b971a464b7312d74b9ca0af2f77cf0b9928a878e8b0fe2" Nov 04 07:43:21.020820 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:21.020795 5030 scope.go:122] "RemoveContainer" containerID="3573923df5a55b4143b971a464b7312d74b9ca0af2f77cf0b9928a878e8b0fe2" Nov 04 07:43:21.021063 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:43:21.021048 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3573923df5a55b4143b971a464b7312d74b9ca0af2f77cf0b9928a878e8b0fe2\": container with ID starting with 3573923df5a55b4143b971a464b7312d74b9ca0af2f77cf0b9928a878e8b0fe2 not found: ID does not exist" containerID="3573923df5a55b4143b971a464b7312d74b9ca0af2f77cf0b9928a878e8b0fe2" Nov 04 07:43:21.021115 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:21.021071 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3573923df5a55b4143b971a464b7312d74b9ca0af2f77cf0b9928a878e8b0fe2"} err="failed to get container status \"3573923df5a55b4143b971a464b7312d74b9ca0af2f77cf0b9928a878e8b0fe2\": rpc error: code = NotFound desc = could not find container \"3573923df5a55b4143b971a464b7312d74b9ca0af2f77cf0b9928a878e8b0fe2\": container with ID starting with 3573923df5a55b4143b971a464b7312d74b9ca0af2f77cf0b9928a878e8b0fe2 not found: ID does not exist" Nov 04 07:43:21.041927 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:21.041908 5030 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g"] Nov 04 07:43:21.043753 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:21.043732 5030 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-1f6ce4-openshift-default-774f8ff68c-czm6g"] Nov 04 07:43:22.140774 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:43:22.140736 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:43:22.147723 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:22.147694 5030 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e155c8ba-0187-49e8-b9fd-228502823f6b" path="/var/lib/kubelet/pods/e155c8ba-0187-49e8-b9fd-228502823f6b/volumes" Nov 04 07:43:36.125703 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:36.125673 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-pw7r7_734fadd0-bd20-46bd-bbca-0bebc35db24d/manager/0.log" Nov 04 07:43:36.808613 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:36.808571 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-mcg7w_41781aaa-b723-4863-928f-6a0925384d73/manager/0.log" Nov 04 07:43:37.912780 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:37.912749 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-69f57ff875-j5qjr_7ede4643-54d3-4cce-b3d3-f5f712530980/maas-api/0.log" Nov 04 07:43:43.372755 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:43.372725 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-fmj2k_4a95000c-9422-41b9-83e9-659fc26dfaa6/manager/0.log" Nov 04 07:43:43.560667 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:43.560635 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-jtwwh_31939c31-8295-4fba-8811-96765f243312/manager/0.log" Nov 04 07:43:43.735823 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:43.735797 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-xwnp7_e2956fe2-f38a-4d14-8973-00f8ec02a0fb/kuadrant-console-plugin/0.log" Nov 04 07:43:44.285531 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:44.285500 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-sqpgg_4139aec4-ab58-4f94-b036-3475c0c8d459/manager/0.log" Nov 04 07:43:44.506604 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:44.506570 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-z9lc6_bad7bc32-bbd4-41c7-8fc5-04ca96400ce1/limitador/0.log" Nov 04 07:43:44.683978 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:44.683948 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-4c2q5_92015ad5-dc71-4822-beac-d8a06dc412dc/manager/0.log" Nov 04 07:43:45.648154 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:45.648114 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-576b8db9c752pzq_ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b/istio-proxy/0.log" Nov 04 07:43:45.858361 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:45.858333 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-8j245_7736c518-c73d-486b-bd3a-dd38aa8182a3/discovery/0.log" Nov 04 07:43:46.612001 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:46.611973 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74854d8ccf-5qthm_896d5293-0791-4af3-85b4-ba92315d3616/istio-proxy/0.log" Nov 04 07:43:47.673021 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:47.672990 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74854d8ccf-mvvkh_fc99ae93-4fe9-496c-aa62-f393f3590e85/istio-proxy/0.log" Nov 04 07:43:47.860073 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:47.860040 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74854d8ccf-r7fn5_61a96e7a-6295-45e8-8d2d-f973cb933048/istio-proxy/0.log" Nov 04 07:43:48.417387 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:48.417353 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859_d83d8983-692a-47e2-b13f-978cb25085e1/istio-proxy/0.log" Nov 04 07:43:48.979575 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:43:48.979539 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d87c68c59-n7zhf_c96c91ba-0da0-4c2c-a881-e3ffffe63714/router/0.log" Nov 04 07:43:52.141580 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:43:52.141544 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:44:05.410078 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:05.410045 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dh9b9_aa159b4a-95ad-4a99-ae91-995c34fc44c1/global-pull-secret-syncer/0.log" Nov 04 07:44:05.643645 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:05.643615 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-kfsw5_5240a510-6179-45d9-bb60-b3fc3054e304/connection-checker/0.log" Nov 04 07:44:05.700534 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:05.700505 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-smsdz_6307c016-6fa4-4890-a9e5-0a0ad2f4a484/connection-checker/0.log" Nov 04 07:44:05.782893 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:05.782866 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-wzwrl_712361a9-8da4-4367-b3e9-a60bdc909482/connection-checker/0.log" Nov 04 07:44:05.913180 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:05.913147 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d9d49_9b959b9f-cdaa-46cf-9775-593ee2ee7ed5/konnectivity-agent/0.log" Nov 04 07:44:06.037004 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:06.036920 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-91.us-east-2.compute.internal_13dc07ab33ee08dade7a82db0cc41bf9/haproxy/0.log" Nov 04 07:44:09.391697 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:09.391667 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-pw7r7_734fadd0-bd20-46bd-bbca-0bebc35db24d/manager/0.log" Nov 04 07:44:10.094911 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:10.094871 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-mcg7w_41781aaa-b723-4863-928f-6a0925384d73/manager/0.log" Nov 04 07:44:11.328239 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:11.328205 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-pw7r7_734fadd0-bd20-46bd-bbca-0bebc35db24d/manager/0.log" Nov 04 07:44:11.938571 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:11.938529 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-mcg7w_41781aaa-b723-4863-928f-6a0925384d73/manager/0.log" Nov 04 07:44:12.685790 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:12.685758 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-fmj2k_4a95000c-9422-41b9-83e9-659fc26dfaa6/manager/0.log" Nov 04 07:44:12.734772 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:12.734736 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-jtwwh_31939c31-8295-4fba-8811-96765f243312/manager/0.log" Nov 04 07:44:12.776669 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:12.776644 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-xwnp7_e2956fe2-f38a-4d14-8973-00f8ec02a0fb/kuadrant-console-plugin/0.log" Nov 04 07:44:13.096196 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:13.096105 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-sqpgg_4139aec4-ab58-4f94-b036-3475c0c8d459/manager/0.log" Nov 04 07:44:13.183950 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:13.183910 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-z9lc6_bad7bc32-bbd4-41c7-8fc5-04ca96400ce1/limitador/0.log" Nov 04 07:44:13.260474 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:13.260433 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-pw7r7_734fadd0-bd20-46bd-bbca-0bebc35db24d/manager/0.log" Nov 04 07:44:13.266246 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:13.266221 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-4c2q5_92015ad5-dc71-4822-beac-d8a06dc412dc/manager/0.log" Nov 04 07:44:13.929001 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:13.928962 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-mcg7w_41781aaa-b723-4863-928f-6a0925384d73/manager/0.log" Nov 04 07:44:15.048830 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.048798 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-hb4ng_f12932cd-facc-4cf2-bd45-d359ae6d6012/cluster-monitoring-operator/0.log" Nov 04 07:44:15.143049 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.143015 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-576b8db9c752pzq_ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b/istio-proxy/0.log" Nov 04 07:44:15.250667 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.250639 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-8j245_7736c518-c73d-486b-bd3a-dd38aa8182a3/discovery/0.log" Nov 04 07:44:15.402640 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.402555 5030 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n"] Nov 04 07:44:15.402990 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.402978 5030 cpu_manager.go:414] "containerMap: removing container" podUID="be3e307f-5c30-440f-80d2-27e34f2f42b4" containerName="istio-proxy" Nov 04 07:44:15.403033 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.402992 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be3e307f-5c30-440f-80d2-27e34f2f42b4" containerName="istio-proxy" Nov 04 07:44:15.403033 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.403006 5030 cpu_manager.go:414] "containerMap: removing container" podUID="319e0009-e6ee-4ab1-8824-ed4e94acb449" containerName="istio-proxy" Nov 04 07:44:15.403033 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.403011 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="319e0009-e6ee-4ab1-8824-ed4e94acb449" containerName="istio-proxy" Nov 04 07:44:15.403033 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.403031 5030 cpu_manager.go:414] "containerMap: removing container" podUID="e155c8ba-0187-49e8-b9fd-228502823f6b" containerName="istio-proxy" Nov 04 07:44:15.403175 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.403037 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e155c8ba-0187-49e8-b9fd-228502823f6b" containerName="istio-proxy" Nov 04 07:44:15.403175 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.403043 5030 cpu_manager.go:414] "containerMap: removing container" podUID="0bfa3bff-cfdb-411a-b746-438a8cd8aaf3" containerName="istio-proxy" Nov 04 07:44:15.403175 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.403048 5030 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0bfa3bff-cfdb-411a-b746-438a8cd8aaf3" containerName="istio-proxy" Nov 04 07:44:15.403175 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.403112 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="be3e307f-5c30-440f-80d2-27e34f2f42b4" containerName="istio-proxy" Nov 04 07:44:15.403175 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.403121 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="319e0009-e6ee-4ab1-8824-ed4e94acb449" containerName="istio-proxy" Nov 04 07:44:15.403175 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.403143 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="e155c8ba-0187-49e8-b9fd-228502823f6b" containerName="istio-proxy" Nov 04 07:44:15.403175 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.403151 5030 memory_manager.go:365] "RemoveStaleState removing state" podUID="0bfa3bff-cfdb-411a-b746-438a8cd8aaf3" containerName="istio-proxy" Nov 04 07:44:15.406391 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.406376 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n" Nov 04 07:44:15.423842 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.423812 5030 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zs2zc\"/\"default-dockercfg-6mkpg\"" Nov 04 07:44:15.424050 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.424035 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zs2zc\"/\"kube-root-ca.crt\"" Nov 04 07:44:15.424127 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.424111 5030 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zs2zc\"/\"openshift-service-ca.crt\"" Nov 04 07:44:15.424508 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.424478 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n"] Nov 04 07:44:15.497554 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.497513 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/019d409e-edf3-4e8c-9445-5879203f8e1c-lib-modules\") pod \"perf-node-gather-daemonset-dbn4n\" (UID: \"019d409e-edf3-4e8c-9445-5879203f8e1c\") " pod="openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n" Nov 04 07:44:15.497725 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.497560 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/019d409e-edf3-4e8c-9445-5879203f8e1c-proc\") pod \"perf-node-gather-daemonset-dbn4n\" (UID: \"019d409e-edf3-4e8c-9445-5879203f8e1c\") " pod="openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n" Nov 04 07:44:15.497725 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.497654 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc7cz\" (UniqueName: \"kubernetes.io/projected/019d409e-edf3-4e8c-9445-5879203f8e1c-kube-api-access-qc7cz\") pod \"perf-node-gather-daemonset-dbn4n\" (UID: \"019d409e-edf3-4e8c-9445-5879203f8e1c\") " pod="openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n" Nov 04 07:44:15.497725 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.497692 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/019d409e-edf3-4e8c-9445-5879203f8e1c-sys\") pod \"perf-node-gather-daemonset-dbn4n\" (UID: \"019d409e-edf3-4e8c-9445-5879203f8e1c\") " pod="openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n" Nov 04 07:44:15.497856 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.497827 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/019d409e-edf3-4e8c-9445-5879203f8e1c-podres\") pod \"perf-node-gather-daemonset-dbn4n\" (UID: \"019d409e-edf3-4e8c-9445-5879203f8e1c\") " pod="openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n" Nov 04 07:44:15.598897 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.598854 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/019d409e-edf3-4e8c-9445-5879203f8e1c-podres\") pod \"perf-node-gather-daemonset-dbn4n\" (UID: \"019d409e-edf3-4e8c-9445-5879203f8e1c\") " pod="openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n" Nov 04 07:44:15.599087 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.598912 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/019d409e-edf3-4e8c-9445-5879203f8e1c-lib-modules\") pod \"perf-node-gather-daemonset-dbn4n\" (UID: \"019d409e-edf3-4e8c-9445-5879203f8e1c\") " pod="openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n" Nov 04 07:44:15.599087 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.598934 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/019d409e-edf3-4e8c-9445-5879203f8e1c-proc\") pod \"perf-node-gather-daemonset-dbn4n\" (UID: \"019d409e-edf3-4e8c-9445-5879203f8e1c\") " pod="openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n" Nov 04 07:44:15.599087 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.598961 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc7cz\" (UniqueName: \"kubernetes.io/projected/019d409e-edf3-4e8c-9445-5879203f8e1c-kube-api-access-qc7cz\") pod \"perf-node-gather-daemonset-dbn4n\" (UID: \"019d409e-edf3-4e8c-9445-5879203f8e1c\") " pod="openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n" Nov 04 07:44:15.599087 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.598981 5030 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/019d409e-edf3-4e8c-9445-5879203f8e1c-sys\") pod \"perf-node-gather-daemonset-dbn4n\" (UID: \"019d409e-edf3-4e8c-9445-5879203f8e1c\") " pod="openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n" Nov 04 07:44:15.599087 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.599008 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/019d409e-edf3-4e8c-9445-5879203f8e1c-podres\") pod \"perf-node-gather-daemonset-dbn4n\" (UID: \"019d409e-edf3-4e8c-9445-5879203f8e1c\") " pod="openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n" Nov 04 07:44:15.599087 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.599049 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/019d409e-edf3-4e8c-9445-5879203f8e1c-proc\") pod \"perf-node-gather-daemonset-dbn4n\" (UID: \"019d409e-edf3-4e8c-9445-5879203f8e1c\") " pod="openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n" Nov 04 07:44:15.599336 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.599088 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/019d409e-edf3-4e8c-9445-5879203f8e1c-lib-modules\") pod \"perf-node-gather-daemonset-dbn4n\" (UID: \"019d409e-edf3-4e8c-9445-5879203f8e1c\") " pod="openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n" Nov 04 07:44:15.599336 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.599092 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/019d409e-edf3-4e8c-9445-5879203f8e1c-sys\") pod \"perf-node-gather-daemonset-dbn4n\" (UID: \"019d409e-edf3-4e8c-9445-5879203f8e1c\") " pod="openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n" Nov 04 07:44:15.612814 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.612785 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc7cz\" (UniqueName: \"kubernetes.io/projected/019d409e-edf3-4e8c-9445-5879203f8e1c-kube-api-access-qc7cz\") pod \"perf-node-gather-daemonset-dbn4n\" (UID: \"019d409e-edf3-4e8c-9445-5879203f8e1c\") " pod="openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n" Nov 04 07:44:15.707625 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.707580 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xnt59_83169317-50c1-49f2-b371-b9773e8c3b77/node-exporter/0.log" Nov 04 07:44:15.719288 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.719259 5030 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n" Nov 04 07:44:15.787110 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.787085 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xnt59_83169317-50c1-49f2-b371-b9773e8c3b77/kube-rbac-proxy/0.log" Nov 04 07:44:15.823161 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:15.823122 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xnt59_83169317-50c1-49f2-b371-b9773e8c3b77/init-textfile/0.log" Nov 04 07:44:16.002189 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:16.002162 5030 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n"] Nov 04 07:44:16.003442 ip-10-0-130-91 kubenswrapper[5030]: W1104 07:44:16.003416 5030 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod019d409e_edf3_4e8c_9445_5879203f8e1c.slice/crio-39b89f5b05cd46a997f74fea2639fc592ed37753555b105f29f26ae82cf3dae4 WatchSource:0}: Error finding container 39b89f5b05cd46a997f74fea2639fc592ed37753555b105f29f26ae82cf3dae4: Status 404 returned error can't find the container with id 39b89f5b05cd46a997f74fea2639fc592ed37753555b105f29f26ae82cf3dae4 Nov 04 07:44:16.303824 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:16.303732 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n" event={"ID":"019d409e-edf3-4e8c-9445-5879203f8e1c","Type":"ContainerStarted","Data":"59ac8f6b8deed998e79b0de89823a8fe00999dfcdb33f0f36aeac80a057788b4"} Nov 04 07:44:16.303824 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:16.303787 5030 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n" event={"ID":"019d409e-edf3-4e8c-9445-5879203f8e1c","Type":"ContainerStarted","Data":"39b89f5b05cd46a997f74fea2639fc592ed37753555b105f29f26ae82cf3dae4"} Nov 04 07:44:16.304257 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:16.303858 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n" Nov 04 07:44:16.327349 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:16.327292 5030 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n" podStartSLOduration=1.327279194 podStartE2EDuration="1.327279194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 07:44:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 07:44:16.324459242 +0000 UTC m=+1730.307087436" watchObservedRunningTime="2026-11-04 07:44:16.327279194 +0000 UTC m=+1730.309907386" Nov 04 07:44:16.507753 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:16.507719 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-dt85l_5c2bf7dd-35c2-400f-8d4f-96915d5c7ef6/prometheus-operator-admission-webhook/0.log" Nov 04 07:44:16.565329 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:16.565238 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74854d8ccf-5qthm_896d5293-0791-4af3-85b4-ba92315d3616/istio-proxy/0.log" Nov 04 07:44:16.749855 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:16.749820 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74854d8ccf-mvvkh_fc99ae93-4fe9-496c-aa62-f393f3590e85/istio-proxy/0.log" Nov 04 07:44:16.781307 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:16.781277 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74854d8ccf-r7fn5_61a96e7a-6295-45e8-8d2d-f973cb933048/istio-proxy/0.log" Nov 04 07:44:16.878930 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:16.878836 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859_d83d8983-692a-47e2-b13f-978cb25085e1/istio-proxy/0.log" Nov 04 07:44:16.951918 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:16.951883 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d87c68c59-n7zhf_c96c91ba-0da0-4c2c-a881-e3ffffe63714/router/0.log" Nov 04 07:44:18.272427 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:18.272397 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-86c478bb88-vlsf6_4e036a5c-ee3f-4b8f-a173-b3b6c052bca7/networking-console-plugin/0.log" Nov 04 07:44:18.713206 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:18.713171 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-fmj2k_4a95000c-9422-41b9-83e9-659fc26dfaa6/manager/0.log" Nov 04 07:44:18.739978 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:18.739945 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-jtwwh_31939c31-8295-4fba-8811-96765f243312/manager/0.log" Nov 04 07:44:18.757519 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:18.757494 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-xwnp7_e2956fe2-f38a-4d14-8973-00f8ec02a0fb/kuadrant-console-plugin/0.log" Nov 04 07:44:19.089721 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:19.089637 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-sqpgg_4139aec4-ab58-4f94-b036-3475c0c8d459/manager/0.log" Nov 04 07:44:19.129446 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:19.129413 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-9k9rx_ecfd331a-08c4-43ac-a58c-9f43935d06ed/console-operator/2.log" Nov 04 07:44:19.133798 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:19.133755 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-9k9rx_ecfd331a-08c4-43ac-a58c-9f43935d06ed/console-operator/3.log" Nov 04 07:44:19.150615 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:19.150584 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-z9lc6_bad7bc32-bbd4-41c7-8fc5-04ca96400ce1/limitador/0.log" Nov 04 07:44:19.185974 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:19.185945 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-4c2q5_92015ad5-dc71-4822-beac-d8a06dc412dc/manager/0.log" Nov 04 07:44:19.768946 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:19.768913 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6dd789c8b7-zgqlr_b214cd37-e13b-4d6e-8550-7b43b7abe4c5/download-server/0.log" Nov 04 07:44:20.499311 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:20.499279 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-58c9f5f46d-q8mhz_07b0128a-5ba7-40f9-9f0c-fbfeae05b64e/volume-data-source-validator/0.log" Nov 04 07:44:22.008666 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:22.008631 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6x2rp_8deda5b1-d839-4a8b-b902-8e341ffe5340/dns/0.log" Nov 04 07:44:22.037482 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:22.037453 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6x2rp_8deda5b1-d839-4a8b-b902-8e341ffe5340/kube-rbac-proxy/0.log" Nov 04 07:44:22.140879 ip-10-0-130-91 kubenswrapper[5030]: E1104 07:44:22.140842 5030 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-nx4xj" containerName="extractor" Nov 04 07:44:22.201936 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:22.201906 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4qdls_473ae29e-1292-4044-988e-293d9ae8cfe3/dns-node-resolver/0.log" Nov 04 07:44:22.320092 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:22.320016 5030 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zs2zc/perf-node-gather-daemonset-dbn4n" Nov 04 07:44:22.989482 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:22.989449 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-bdf74958f-jbtcn_4d9b2c9c-957c-4f86-902c-aad734e66096/registry/0.log" Nov 04 07:44:23.072757 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:23.072694 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p4d9h_ee3c09af-7a35-49ff-a0cb-4bafc08875b1/node-ca/0.log" Nov 04 07:44:24.500708 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:24.500677 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-576b8db9c752pzq_ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b/istio-proxy/0.log" Nov 04 07:44:24.635411 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:24.635384 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-8j245_7736c518-c73d-486b-bd3a-dd38aa8182a3/discovery/0.log" Nov 04 07:44:25.595322 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:25.595292 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-8f94f88d4-klvcl_ef49e380-50e5-4bd6-8060-c21e81f84a9f/manager/0.log" Nov 04 07:44:25.622661 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:25.622638 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-8f94f88d4-klvcl_ef49e380-50e5-4bd6-8060-c21e81f84a9f/copy-manifests/0.log" Nov 04 07:44:26.054818 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:26.054789 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74854d8ccf-5qthm_896d5293-0791-4af3-85b4-ba92315d3616/istio-proxy/0.log" Nov 04 07:44:26.295738 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:26.295705 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74854d8ccf-mvvkh_fc99ae93-4fe9-496c-aa62-f393f3590e85/istio-proxy/0.log" Nov 04 07:44:26.337255 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:26.337191 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74854d8ccf-r7fn5_61a96e7a-6295-45e8-8d2d-f973cb933048/istio-proxy/0.log" Nov 04 07:44:26.353246 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:26.353219 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-576b8db9c752pzq_ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b/istio-proxy/0.log" Nov 04 07:44:26.464384 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:26.464356 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859_d83d8983-692a-47e2-b13f-978cb25085e1/istio-proxy/0.log" Nov 04 07:44:26.493568 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:26.493531 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-8j245_7736c518-c73d-486b-bd3a-dd38aa8182a3/discovery/0.log" Nov 04 07:44:26.566387 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:26.566360 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-pw7r7_734fadd0-bd20-46bd-bbca-0bebc35db24d/manager/0.log" Nov 04 07:44:26.697176 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:26.697150 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d87c68c59-n7zhf_c96c91ba-0da0-4c2c-a881-e3ffffe63714/router/0.log" Nov 04 07:44:27.259446 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:27.259416 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-mcg7w_41781aaa-b723-4863-928f-6a0925384d73/manager/0.log" Nov 04 07:44:27.837898 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:27.837866 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74854d8ccf-5qthm_896d5293-0791-4af3-85b4-ba92315d3616/istio-proxy/0.log" Nov 04 07:44:27.983083 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:27.983057 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74854d8ccf-mvvkh_fc99ae93-4fe9-496c-aa62-f393f3590e85/istio-proxy/0.log" Nov 04 07:44:28.001768 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:28.001746 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74854d8ccf-r7fn5_61a96e7a-6295-45e8-8d2d-f973cb933048/istio-proxy/0.log" Nov 04 07:44:28.070210 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:28.070188 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859_d83d8983-692a-47e2-b13f-978cb25085e1/istio-proxy/0.log" Nov 04 07:44:28.086031 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:28.086010 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-576b8db9c752pzq_ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b/istio-proxy/0.log" Nov 04 07:44:28.177771 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:28.177748 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d87c68c59-n7zhf_c96c91ba-0da0-4c2c-a881-e3ffffe63714/router/0.log" Nov 04 07:44:28.186117 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:28.186092 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-8j245_7736c518-c73d-486b-bd3a-dd38aa8182a3/discovery/0.log" Nov 04 07:44:28.263720 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:28.263703 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rtcv5_6652cbf0-521e-411b-9f75-2ce1f7c6a05b/serve-healthcheck-canary/0.log" Nov 04 07:44:28.933455 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:28.933426 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-p5lnr_a1971526-e34c-4dd8-9c6c-b6d9d13356c1/insights-operator/0.log" Nov 04 07:44:28.933885 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:28.933580 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-p5lnr_a1971526-e34c-4dd8-9c6c-b6d9d13356c1/insights-operator/1.log" Nov 04 07:44:29.349230 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:29.349143 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nx4xj_e87e5256-fef7-4160-b3d9-c96d0c01641a/kube-rbac-proxy/0.log" Nov 04 07:44:29.391720 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:29.391693 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nx4xj_e87e5256-fef7-4160-b3d9-c96d0c01641a/exporter/0.log" Nov 04 07:44:29.431534 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:29.431508 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nx4xj_e87e5256-fef7-4160-b3d9-c96d0c01641a/extractor/0.log" Nov 04 07:44:29.464040 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:29.464019 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74854d8ccf-5qthm_896d5293-0791-4af3-85b4-ba92315d3616/istio-proxy/0.log" Nov 04 07:44:29.470463 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:29.470445 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_periodic-gathering-r94v5-lqsc7_a62d2d12-a53b-4493-8268-837be0d5bf17/insights-gathering/0.log" Nov 04 07:44:29.504342 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:29.504321 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_periodic-gathering-twnww-hrp7j_8949591f-9c25-4e76-a673-67eb381ea2e0/insights-gathering/0.log" Nov 04 07:44:29.608429 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:29.608374 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74854d8ccf-mvvkh_fc99ae93-4fe9-496c-aa62-f393f3590e85/istio-proxy/0.log" Nov 04 07:44:29.633357 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:29.633336 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74854d8ccf-r7fn5_61a96e7a-6295-45e8-8d2d-f973cb933048/istio-proxy/0.log" Nov 04 07:44:29.693543 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:29.693523 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859_d83d8983-692a-47e2-b13f-978cb25085e1/istio-proxy/0.log" Nov 04 07:44:29.769395 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:29.769367 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d87c68c59-n7zhf_c96c91ba-0da0-4c2c-a881-e3ffffe63714/router/0.log" Nov 04 07:44:30.073434 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:30.073406 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-576b8db9c752pzq_ae3d04f0-aadb-4a3d-9b50-dd5d42c5b94b/istio-proxy/0.log" Nov 04 07:44:30.178282 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:30.178251 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-8j245_7736c518-c73d-486b-bd3a-dd38aa8182a3/discovery/0.log" Nov 04 07:44:31.488668 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:31.488631 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74854d8ccf-5qthm_896d5293-0791-4af3-85b4-ba92315d3616/istio-proxy/0.log" Nov 04 07:44:31.640072 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:31.640028 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74854d8ccf-mvvkh_fc99ae93-4fe9-496c-aa62-f393f3590e85/istio-proxy/0.log" Nov 04 07:44:31.661035 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:31.661017 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74854d8ccf-r7fn5_61a96e7a-6295-45e8-8d2d-f973cb933048/istio-proxy/0.log" Nov 04 07:44:31.727336 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:31.727315 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-fc457bc99-bj859_d83d8983-692a-47e2-b13f-978cb25085e1/istio-proxy/0.log" Nov 04 07:44:31.804059 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:31.804005 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d87c68c59-n7zhf_c96c91ba-0da0-4c2c-a881-e3ffffe63714/router/0.log" Nov 04 07:44:32.446834 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:32.446804 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-8f94f88d4-klvcl_ef49e380-50e5-4bd6-8060-c21e81f84a9f/manager/0.log" Nov 04 07:44:32.515827 ip-10-0-130-91 kubenswrapper[5030]: I1104 07:44:32.515800 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-8f94f88d4-klvcl_ef49e380-50e5-4bd6-8060-c21e81f84a9f/copy-manifests/0.log"