Nov 04 01:10:04.384263 ip-10-0-131-51 systemd[1]: Starting Kubernetes Kubelet...
Nov 04 01:10:04.829739 ip-10-0-131-51 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 01:10:04.829739 ip-10-0-131-51 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 04 01:10:04.829739 ip-10-0-131-51 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 01:10:04.829739 ip-10-0-131-51 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 01:10:04.834312 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834230    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:10:04.834312 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834308    2571 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:10:04.834312 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834312    2571 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:10:04.834312 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834315    2571 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:10:04.834483 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834320    2571 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:10:04.834483 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834324    2571 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:10:04.834483 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834327    2571 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:10:04.834483 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834330    2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:10:04.834483 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834333    2571 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:10:04.834483 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834336    2571 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:10:04.834483 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834338    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:10:04.834483 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834341    2571 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:10:04.834483 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834343    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:10:04.834483 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834346    2571 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:10:04.834483 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834349    2571 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:10:04.834483 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834351    2571 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:10:04.834483 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834354    2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:10:04.834483 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834357    2571 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:10:04.834483 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834359    2571 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:10:04.834483 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834362    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:10:04.834483 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834364    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:10:04.834483 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834367    2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:10:04.834483 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834370    2571 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:10:04.834924 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834372    2571 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:10:04.834924 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834375    2571 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:10:04.834924 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834377    2571 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:10:04.834924 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834380    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:10:04.834924 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834388    2571 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:10:04.834924 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834391    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:10:04.834924 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834394    2571 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:10:04.834924 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834396    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:10:04.834924 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834399    2571 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:10:04.834924 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834402    2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:10:04.834924 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834404    2571 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:10:04.834924 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834407    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:10:04.834924 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834409    2571 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:10:04.834924 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834412    2571 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:10:04.834924 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834415    2571 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:10:04.834924 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834417    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:10:04.834924 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834420    2571 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:10:04.834924 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834423    2571 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:10:04.834924 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834425    2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:10:04.835382 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834428    2571 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:10:04.835382 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834438    2571 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:10:04.835382 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834442    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:10:04.835382 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834445    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:10:04.835382 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834447    2571 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:10:04.835382 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834450    2571 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:10:04.835382 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834452    2571 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:10:04.835382 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834455    2571 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:10:04.835382 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834457    2571 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:10:04.835382 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834460    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:10:04.835382 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834462    2571 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:10:04.835382 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834465    2571 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:10:04.835382 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834468    2571 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:10:04.835382 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834470    2571 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:10:04.835382 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834473    2571 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:10:04.835382 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834475    2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:10:04.835382 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834478    2571 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:10:04.835382 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834481    2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:10:04.835382 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834483    2571 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:10:04.835382 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834486    2571 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:10:04.835844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834489    2571 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:10:04.835844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834492    2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:10:04.835844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834494    2571 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:10:04.835844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834497    2571 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:10:04.835844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834499    2571 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:10:04.835844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834502    2571 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:10:04.835844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834505    2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:10:04.835844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834510    2571 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:10:04.835844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834512    2571 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:10:04.835844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834515    2571 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:10:04.835844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834518    2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:10:04.835844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834520    2571 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:10:04.835844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834523    2571 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:10:04.835844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834525    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:10:04.835844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834529    2571 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:10:04.835844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834533    2571 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:10:04.835844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834536    2571 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:10:04.835844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834539    2571 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:10:04.835844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834543    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:10:04.836335 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834545    2571 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:10:04.836335 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834548    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:10:04.836335 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834551    2571 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:10:04.836335 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834554    2571 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:10:04.836335 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834557    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:10:04.836335 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834559    2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:10:04.836335 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834562    2571 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:10:04.836335 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834564    2571 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:10:04.836335 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834568    2571 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:10:04.836335 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834570    2571 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:10:04.836335 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834573    2571 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:10:04.836335 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834576    2571 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:10:04.836335 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834579    2571 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:10:04.836335 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834581    2571 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:10:04.836335 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834584    2571 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:10:04.836335 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834586    2571 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:10:04.836335 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834589    2571 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:10:04.836335 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834593    2571 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:10:04.836335 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834595    2571 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:10:04.836335 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834597    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:10:04.836808 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834601    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:10:04.836808 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834604    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:10:04.836808 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834606    2571 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:10:04.836808 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834609    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:10:04.836808 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.834612    2571 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:10:04.836808 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835450    2571 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:10:04.836808 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835459    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:10:04.836808 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835463    2571 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:10:04.836808 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835466    2571 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:10:04.836808 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835468    2571 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:10:04.836808 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835471    2571 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:10:04.836808 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835474    2571 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:10:04.836808 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835477    2571 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:10:04.836808 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835480    2571 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:10:04.836808 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835483    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:10:04.836808 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835486    2571 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:10:04.836808 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835489    2571 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:10:04.836808 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835492    2571 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:10:04.836808 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835494    2571 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:10:04.837299 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835497    2571 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:10:04.837299 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835500    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:10:04.837299 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835503    2571 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:10:04.837299 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835505    2571 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:10:04.837299 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835508    2571 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:10:04.837299 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835511    2571 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:10:04.837299 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835513    2571 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:10:04.837299 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835516    2571 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:10:04.837299 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835518    2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:10:04.837299 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835521    2571 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:10:04.837299 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835523    2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:10:04.837299 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835526    2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:10:04.837299 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835528    2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:10:04.837299 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835532    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:10:04.837299 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835534    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:10:04.837299 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835537    2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:10:04.837299 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835540    2571 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:10:04.837299 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835542    2571 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:10:04.837299 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835545    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:10:04.837299 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835548    2571 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:10:04.837773 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835550    2571 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:10:04.837773 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835553    2571 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:10:04.837773 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835555    2571 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:10:04.837773 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835558    2571 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:10:04.837773 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835561    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:10:04.837773 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835563    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:10:04.837773 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835566    2571 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:10:04.837773 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835568    2571 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:10:04.837773 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835571    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:10:04.837773 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835574    2571 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:10:04.837773 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835576    2571 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:10:04.837773 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835579    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:10:04.837773 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835581    2571 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:10:04.837773 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835585    2571 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:10:04.837773 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835589    2571 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:10:04.837773 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835592    2571 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:10:04.837773 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835595    2571 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:10:04.837773 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835597    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:10:04.837773 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835600    2571 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:10:04.838272 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835602    2571 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:10:04.838272 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835605    2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:10:04.838272 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835607    2571 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:10:04.838272 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835609    2571 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:10:04.838272 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835612    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:10:04.838272 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835615    2571 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:10:04.838272 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835618    2571 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:10:04.838272 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835620    2571 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:10:04.838272 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835623    2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:10:04.838272 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835625    2571 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:10:04.838272 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835628    2571 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:10:04.838272 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835630    2571 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:10:04.838272 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835633    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:10:04.838272 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835635    2571 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:10:04.838272 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835638    2571 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:10:04.838272 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835640    2571 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:10:04.838272 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835643    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:10:04.838272 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835645    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:10:04.838272 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835648    2571 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:10:04.838730 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835650    2571 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:10:04.838730 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835653    2571 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:10:04.838730 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835655    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:10:04.838730 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835658    2571 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:10:04.838730 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835661    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:10:04.838730 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835664    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:10:04.838730 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835667    2571 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:10:04.838730 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835669    2571 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:10:04.838730 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835673    2571 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:10:04.838730 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835676    2571 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:10:04.838730 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835679    2571 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:10:04.838730 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835682    2571 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:10:04.838730 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835685    2571 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:10:04.838730 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835688    2571 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:10:04.838730 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835690    2571 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:10:04.838730 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835692    2571 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:10:04.838730 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835695    2571 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:10:04.838730 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835698    2571 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:10:04.838730 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835701    2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:10:04.839196 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835704    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:10:04.839196 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835707    2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:10:04.839196 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835710    2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:10:04.839196 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835712    2571 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:10:04.839196 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835715    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:10:04.839196 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835718    2571 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:10:04.839196 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835720    2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:10:04.839196 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835723    2571 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:10:04.839196 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835725    2571 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:10:04.839196 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835728    2571 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:10:04.839196 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835731    2571 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:10:04.839196 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835733    2571 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:10:04.839196 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835736    2571 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:10:04.839196 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835738    2571 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:10:04.839196 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.835741    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:10:04.839196 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836280    2571 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:10:04.839196 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836287    2571 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:10:04.839196 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836291    2571 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:10:04.839196 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836294    2571 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:10:04.839196 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836298    2571 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:10:04.839660 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836300    2571 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:10:04.839660 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836303    2571 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:10:04.839660 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836306    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:10:04.839660 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836308    2571 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:10:04.839660 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836311    2571 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:10:04.839660 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836313    2571 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:10:04.839660 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836316    2571 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:10:04.839660 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836319    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:10:04.839660 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836321    2571 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:10:04.839660 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836325    2571 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:10:04.839660 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836329    2571 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:10:04.839660 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836333    2571 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:10:04.839660 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836336    2571 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:10:04.839660 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836339    2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:10:04.839660 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836343    2571 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:10:04.839660 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836345    2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:10:04.839660 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836348    2571 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:10:04.839660 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836351    2571 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:10:04.839660 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836354    2571 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:10:04.839660 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836356    2571 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:10:04.840134 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836359    2571 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:10:04.840134 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836362    2571 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:10:04.840134 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836364    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:10:04.840134 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836367    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:10:04.840134 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836369    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:10:04.840134 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836372    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:10:04.840134 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836375    2571 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:10:04.840134 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836377    2571 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:10:04.840134 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836380    2571 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:10:04.840134 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836382    2571 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:10:04.840134 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836386    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:10:04.840134 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836388    2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:10:04.840134 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836391    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:10:04.840134 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836393    2571 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:10:04.840134 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836396    2571 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:10:04.840134 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836399    2571 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:10:04.840134 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836401    2571 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:10:04.840134 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836404    2571 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:10:04.840134 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836407    2571 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:10:04.840573 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836409    2571 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:10:04.840573 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836412    2571 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:10:04.840573 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836414    2571 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:10:04.840573 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836417    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:10:04.840573 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836419    2571 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:10:04.840573 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836422    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:10:04.840573 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836425    2571 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:10:04.840573 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836428    2571 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:10:04.840573 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836431    2571 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:10:04.840573 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836433    2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:10:04.840573 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836435    2571 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:10:04.840573 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836438    2571 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:10:04.840573 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836440    2571 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:10:04.840573 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836443    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:10:04.840573 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836446    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:10:04.840573 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836448    2571 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:10:04.840573 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836450    2571 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:10:04.840573 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836453    2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:10:04.840573 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836455    2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:10:04.841023 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836458    2571 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:10:04.841023 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836460    2571 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:10:04.841023 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836463    2571 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:10:04.841023 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836466    2571 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:10:04.841023 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836468    2571 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:10:04.841023 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836474    2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:10:04.841023 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836477    2571 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:10:04.841023 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836479    2571 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:10:04.841023 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836482    2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:10:04.841023 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836486    2571 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:10:04.841023 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836490    2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:10:04.841023 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836493    2571 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:10:04.841023 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836495    2571 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:10:04.841023 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836498    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:10:04.841023 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836500    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:10:04.841023 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836503    2571 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:10:04.841023 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836505    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:10:04.841023 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836507    2571 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:10:04.841023 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836510    2571 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:10:04.841458 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836512    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:10:04.841458 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836515    2571 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:10:04.841458 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836517    2571 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:10:04.841458 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836520    2571 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:10:04.841458 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836522    2571 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:10:04.841458 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836525    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:10:04.841458 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836528    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:10:04.841458 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836530    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:10:04.841458 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836533    2571 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:10:04.841458 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836536    2571 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:10:04.841458 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836538    2571 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:10:04.841458 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836541    2571 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:10:04.841458 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836543    2571 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:10:04.841458 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836546    2571 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:10:04.841458 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836548    2571 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:10:04.841458 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836551    2571 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:10:04.841458 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836554    2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:10:04.841458 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836556    2571 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:10:04.841458 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836559    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:10:04.841948 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836562    2571 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:10:04.841948 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836564    2571 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:10:04.841948 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836568    2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:10:04.841948 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836571    2571 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:10:04.841948 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.836573    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:10:04.841948 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837690    2571 flags.go:64] FLAG: --address="0.0.0.0"
Nov 04 01:10:04.841948 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837699    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 04 01:10:04.841948 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837706    2571 flags.go:64] FLAG: --anonymous-auth="true"
Nov 04 01:10:04.841948 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837711    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 04 01:10:04.841948 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837716    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 04 01:10:04.841948 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837719    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 04 01:10:04.841948 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837723    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 04 01:10:04.841948 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837728    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 04 01:10:04.841948 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837733    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 04 01:10:04.841948 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837737    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 04 01:10:04.841948 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837740    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 04 01:10:04.841948 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837744    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 04 01:10:04.841948 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837747    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 04 01:10:04.841948 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837750    2571 flags.go:64] FLAG: --cgroup-root=""
Nov 04 01:10:04.841948 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837753    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 04 01:10:04.841948 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837756    2571 flags.go:64] FLAG: --client-ca-file=""
Nov 04 01:10:04.841948 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837759    2571 flags.go:64] FLAG: --cloud-provider="external"
Nov 04 01:10:04.841948 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837762    2571 flags.go:64] FLAG: --cluster-dns="[]"
Nov 04 01:10:04.842508 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837765    2571 flags.go:64] FLAG: --cluster-domain=""
Nov 04 01:10:04.842508 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837768    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 04 01:10:04.842508 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837772    2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 04 01:10:04.842508 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837775    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 04 01:10:04.842508 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837778    2571 flags.go:64] FLAG: --container-log-max-files="5"
Nov 04 01:10:04.842508 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837784    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 04 01:10:04.842508 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837787    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 04 01:10:04.842508 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837790    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 04 01:10:04.842508 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837793    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 04 01:10:04.842508 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837796    2571 flags.go:64] FLAG: --contention-profiling="false"
Nov 04 01:10:04.842508 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837801    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 04 01:10:04.842508 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837804    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 04 01:10:04.842508 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837807    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 04 01:10:04.842508 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837810    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 04 01:10:04.842508 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837814    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 04 01:10:04.842508 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837817    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 04 01:10:04.842508 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837820    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 04 01:10:04.842508 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837823    2571 flags.go:64] FLAG: --enable-load-reader="false"
Nov 04 01:10:04.842508 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837826    2571 flags.go:64] FLAG: --enable-server="true"
Nov 04 01:10:04.842508 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837829    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 04 01:10:04.842508 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837833    2571 flags.go:64] FLAG: --event-burst="100"
Nov 04 01:10:04.842508 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837836    2571 flags.go:64] FLAG: --event-qps="50"
Nov 04 01:10:04.842508 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837841    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 04 01:10:04.842508 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837844    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 04 01:10:04.843135 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837847    2571 flags.go:64] FLAG: --eviction-hard=""
Nov 04 01:10:04.843135 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837851    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 04 01:10:04.843135 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837854    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 04 01:10:04.843135 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837857    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 04 01:10:04.843135 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837860    2571 flags.go:64] FLAG: --eviction-soft=""
Nov 04 01:10:04.843135 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837863    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 04 01:10:04.843135 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837866    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 04 01:10:04.843135 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837869    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 04 01:10:04.843135 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837872    2571 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 04 01:10:04.843135 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837875    2571 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 04 01:10:04.843135 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837878    2571 flags.go:64] FLAG: --fail-swap-on="true"
Nov 04 01:10:04.843135 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837881    2571 flags.go:64] FLAG: --feature-gates=""
Nov 04 01:10:04.843135 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837885    2571 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 04 01:10:04.843135 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837890    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 04 01:10:04.843135 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837893    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 04 01:10:04.843135 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837896    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 04 01:10:04.843135 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837899    2571 flags.go:64] FLAG: --healthz-port="10248"
Nov 04 01:10:04.843135 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837903    2571 flags.go:64] FLAG: --help="false"
Nov 04 01:10:04.843135 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837906    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:10:04.843135 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837909    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 04 01:10:04.843135 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837912    2571 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 04 01:10:04.843135 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837915    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 04 01:10:04.843135 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837918    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837922    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837925    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837927    2571 flags.go:64] FLAG: --image-service-endpoint=""
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837930    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837933    2571 flags.go:64] FLAG: --kube-api-burst="100"
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837936    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837939    2571 flags.go:64] FLAG: --kube-api-qps="50"
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837943    2571 flags.go:64] FLAG: --kube-reserved=""
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837946    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837949    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837952    2571 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837955    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837958    2571 flags.go:64] FLAG: --lock-file=""
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837961    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837963    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837979    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837984    2571 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837987    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837990    2571 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837993    2571 flags.go:64] FLAG: --logging-format="text"
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.837996    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838000    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838004    2571 flags.go:64] FLAG: --manifest-url=""
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838007    2571 flags.go:64] FLAG: --manifest-url-header=""
Nov 04 01:10:04.843667 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838011    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838014    2571 flags.go:64] FLAG: --max-open-files="1000000"
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838018    2571 flags.go:64] FLAG: --max-pods="110"
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838021    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838024    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838027    2571 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838030    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838033    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838037    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838040    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838047    2571 flags.go:64] FLAG: --node-status-max-images="50"
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838050    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838053    2571 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838056    2571 flags.go:64] FLAG: --pod-cidr=""
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838059    2571 flags.go:64] FLAG: --pod-manifest-path=""
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838063    2571 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838066    2571 flags.go:64] FLAG: --pods-per-core="0"
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838069    2571 flags.go:64] FLAG: --port="10250"
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838072    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838075    2571 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-0751df68730cc5e3a"
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838078    2571 flags.go:64] FLAG: --qos-reserved=""
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838081    2571 flags.go:64] FLAG: --read-only-port="10255"
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838084    2571 flags.go:64] FLAG: --register-node="true"
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838087    2571 flags.go:64] FLAG: --register-with-taints=""
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838091    2571 flags.go:64] FLAG: --registry-burst="10"
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838094    2571 flags.go:64] FLAG: --registry-qps="5"
Nov 04 01:10:04.844293 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838097    2571 flags.go:64] FLAG: --reserved-cpus=""
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838099    2571 flags.go:64] FLAG: --reserved-memory=""
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838104    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838107    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838111    2571 flags.go:64] FLAG: --rotate-certificates="false"
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838114    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838117    2571 flags.go:64] FLAG: --runonce="false"
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838120    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838123    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838126    2571 flags.go:64] FLAG: --seccomp-default="false"
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838129    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838132    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838136    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838138    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838142    2571 flags.go:64] FLAG: --storage-driver-password="root"
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838145    2571 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838147    2571 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838150    2571 flags.go:64] FLAG: --storage-driver-user="root"
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838153    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838156    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838159    2571 flags.go:64] FLAG: --system-cgroups=""
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838164    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838169    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838172    2571 flags.go:64] FLAG: --tls-cert-file=""
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838175    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 04 01:10:04.844957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838179    2571 flags.go:64] FLAG: --tls-min-version=""
Nov 04 01:10:04.845555 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838181    2571 flags.go:64] FLAG: --tls-private-key-file=""
Nov 04 01:10:04.845555 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838184    2571 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 04 01:10:04.845555 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838187    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 04 01:10:04.845555 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838190    2571 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 04 01:10:04.845555 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838193    2571 flags.go:64] FLAG: --v="2"
Nov 04 01:10:04.845555 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838197    2571 flags.go:64] FLAG: --version="false"
Nov 04 01:10:04.845555 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838201    2571 flags.go:64] FLAG: --vmodule=""
Nov 04 01:10:04.845555 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838205    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 04 01:10:04.845555 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838208    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 04 01:10:04.845555 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838349    2571 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:10:04.845555 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838354    2571 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:10:04.845555 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838357    2571 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:10:04.845555 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838360    2571 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:10:04.845555 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838363    2571 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:10:04.845555 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838366    2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:10:04.845555 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838369    2571 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:10:04.845555 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838371    2571 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:10:04.845555 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838374    2571 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:10:04.845555 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838377    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:10:04.845555 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838380    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:10:04.845555 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838383    2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:10:04.845555 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838386    2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:10:04.846083 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838388    2571 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:10:04.846083 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838391    2571 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:10:04.846083 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838393    2571 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:10:04.846083 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838396    2571 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:10:04.846083 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838398    2571 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:10:04.846083 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838402    2571 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:10:04.846083 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838404    2571 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:10:04.846083 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838407    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:10:04.846083 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838410    2571 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:10:04.846083 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838413    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:10:04.846083 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838415    2571 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:10:04.846083 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838418    2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:10:04.846083 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838420    2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:10:04.846083 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838423    2571 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:10:04.846083 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838425    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:10:04.846083 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838428    2571 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:10:04.846083 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838439    2571 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:10:04.846083 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838442    2571 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:10:04.846083 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838445    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:10:04.846083 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838447    2571 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:10:04.846564 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838450    2571 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:10:04.846564 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838453    2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:10:04.846564 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838455    2571 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:10:04.846564 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838458    2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:10:04.846564 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838460    2571 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:10:04.846564 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838463    2571 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:10:04.846564 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838465    2571 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:10:04.846564 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838468    2571 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:10:04.846564 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838470    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:10:04.846564 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838473    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:10:04.846564 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838476    2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:10:04.846564 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838478    2571 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:10:04.846564 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838481    2571 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:10:04.846564 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838483    2571 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:10:04.846564 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838486    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:10:04.846564 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838489    2571 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:10:04.846564 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838491    2571 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:10:04.846564 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838495    2571 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:10:04.846564 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838498    2571 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:10:04.846564 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838500    2571 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:10:04.847076 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838503    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:10:04.847076 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838505    2571 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:10:04.847076 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838508    2571 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:10:04.847076 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838510    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:10:04.847076 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838513    2571 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:10:04.847076 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838515    2571 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:10:04.847076 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838518    2571 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:10:04.847076 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838520    2571 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:10:04.847076 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838523    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:10:04.847076 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838525    2571 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:10:04.847076 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838528    2571 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:10:04.847076 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838531    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:10:04.847076 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838533    2571 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:10:04.847076 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838536    2571 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:10:04.847076 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838538    2571 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:10:04.847076 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838542    2571 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:10:04.847076 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838546    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:10:04.847076 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838549    2571 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:10:04.847076 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838551    2571 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:10:04.847524 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838555    2571 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:10:04.847524 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838559    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:10:04.847524 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838562    2571 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:10:04.847524 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838565    2571 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:10:04.847524 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838568    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:10:04.847524 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838571    2571 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:10:04.847524 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838574    2571 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:10:04.847524 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838576    2571 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:10:04.847524 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838578    2571 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:10:04.847524 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838581    2571 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:10:04.847524 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838584    2571 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:10:04.847524 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838586    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:10:04.847524 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838589    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:10:04.847524 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838591    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:10:04.847524 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838594    2571 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:10:04.847524 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838596    2571 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:10:04.847524 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838599    2571 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:10:04.847524 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838601    2571 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:10:04.847524 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838604    2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:10:04.847961 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838606    2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:10:04.847961 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838609    2571 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:10:04.847961 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838611    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:10:04.847961 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838614    2571 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:10:04.847961 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838617    2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:10:04.847961 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838619    2571 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:10:04.847961 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838622    2571 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:10:04.847961 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838624    2571 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:10:04.847961 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838627    2571 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:10:04.847961 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838629    2571 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:10:04.847961 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838632    2571 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:10:04.847961 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838634    2571 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:10:04.847961 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838637    2571 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:10:04.847961 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838639    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:10:04.847961 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838642    2571 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:10:04.847961 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.838669    2571 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 01:10:04.848354 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838704    2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:10:04.848354 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838708    2571 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:10:04.848354 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838711    2571 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:10:04.848354 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838714    2571 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:10:04.848354 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838717    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:10:04.848354 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838720    2571 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:10:04.848354 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838722    2571 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:10:04.848354 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838725    2571 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:10:04.848354 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838728    2571 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:10:04.848354 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838730    2571 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:10:04.848354 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838733    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:10:04.848354 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838735    2571 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:10:04.848354 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838738    2571 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:10:04.848354 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838741    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:10:04.848354 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838744    2571 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:10:04.848354 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838746    2571 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:10:04.848354 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838749    2571 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:10:04.848354 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838751    2571 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:10:04.848354 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838753    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:10:04.848354 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838756    2571 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:10:04.848815 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838758    2571 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:10:04.848815 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838763    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:10:04.848815 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838766    2571 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:10:04.848815 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838768    2571 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:10:04.848815 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838771    2571 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:10:04.848815 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838775    2571 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:10:04.848815 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838779    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:10:04.848815 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838782    2571 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:10:04.848815 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838785    2571 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:10:04.848815 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838788    2571 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:10:04.848815 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838792    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:10:04.848815 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838795    2571 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:10:04.848815 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838799    2571 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:10:04.848815 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838801    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:10:04.848815 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838804    2571 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:10:04.848815 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838807    2571 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:10:04.848815 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838810    2571 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:10:04.848815 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838813    2571 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:10:04.849264 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838815    2571 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:10:04.849264 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838819    2571 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:10:04.849264 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838822    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:10:04.849264 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838824    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:10:04.849264 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838827    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:10:04.849264 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838829    2571 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:10:04.849264 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838832    2571 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:10:04.849264 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838834    2571 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:10:04.849264 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838837    2571 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:10:04.849264 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838839    2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:10:04.849264 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838842    2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:10:04.849264 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838845    2571 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:10:04.849264 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838847    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:10:04.849264 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838850    2571 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:10:04.849264 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838852    2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:10:04.849264 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838858    2571 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:10:04.849264 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838860    2571 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:10:04.849264 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838863    2571 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:10:04.849264 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838865    2571 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:10:04.849264 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838868    2571 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:10:04.849761 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838870    2571 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:10:04.849761 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838873    2571 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:10:04.849761 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838875    2571 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:10:04.849761 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838879    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:10:04.849761 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838881    2571 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:10:04.849761 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838884    2571 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:10:04.849761 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838886    2571 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:10:04.849761 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838889    2571 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:10:04.849761 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838891    2571 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:10:04.849761 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838894    2571 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:10:04.849761 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838897    2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:10:04.849761 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838899    2571 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:10:04.849761 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838902    2571 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:10:04.849761 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838906    2571 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:10:04.849761 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838908    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:10:04.849761 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838911    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:10:04.849761 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838914    2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:10:04.849761 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838917    2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:10:04.849761 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838919    2571 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:10:04.849761 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838921    2571 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:10:04.850241 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838924    2571 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:10:04.850241 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838927    2571 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:10:04.850241 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838929    2571 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:10:04.850241 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838932    2571 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:10:04.850241 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838934    2571 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:10:04.850241 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838937    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:10:04.850241 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838940    2571 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:10:04.850241 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838944    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:10:04.850241 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838946    2571 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:10:04.850241 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838949    2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:10:04.850241 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838951    2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:10:04.850241 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838954    2571 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:10:04.850241 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838956    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:10:04.850241 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838959    2571 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:10:04.850241 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838962    2571 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:10:04.850241 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838977    2571 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:10:04.850241 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838980    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:10:04.850241 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838982    2571 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:10:04.850241 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838985    2571 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:10:04.850241 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838988    2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:10:04.850729 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838990    2571 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:10:04.850729 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838993    2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:10:04.850729 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838995    2571 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:10:04.850729 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.838998    2571 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:10:04.850729 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.839001    2571 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:10:04.850729 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.839005    2571 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:10:04.850729 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.839008    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:10:04.850729 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.839010    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:10:04.850729 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.845768    2571 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 04 01:10:04.850729 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.845782    2571 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 04 01:10:04.850729 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.845797    2571 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 04 01:10:04.850729 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.845801    2571 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 04 01:10:04.850729 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845857    2571 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:10:04.850729 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845862    2571 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:10:04.850729 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845865    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:10:04.850729 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845868    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:10:04.850729 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845871    2571 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:10:04.850729 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845874    2571 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:10:04.850729 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845877    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:10:04.851191 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845880    2571 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:10:04.851191 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845882    2571 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:10:04.851191 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845885    2571 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:10:04.851191 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845888    2571 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:10:04.851191 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845890    2571 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:10:04.851191 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845893    2571 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:10:04.851191 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845897    2571 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:10:04.851191 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845901    2571 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:10:04.851191 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845905    2571 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:10:04.851191 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845907    2571 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:10:04.851191 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845910    2571 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:10:04.851191 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845913    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:10:04.851191 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845916    2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:10:04.851191 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845919    2571 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:10:04.851191 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845921    2571 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:10:04.851191 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845924    2571 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:10:04.851191 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845928    2571 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:10:04.851191 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845931    2571 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:10:04.851191 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845933    2571 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:10:04.851624 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845936    2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:10:04.851624 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845939    2571 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:10:04.851624 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845941    2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:10:04.851624 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845945    2571 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:10:04.851624 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845947    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:10:04.851624 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845950    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:10:04.851624 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845953    2571 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:10:04.851624 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845955    2571 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:10:04.851624 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845958    2571 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:10:04.851624 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845961    2571 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:10:04.851624 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845963    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:10:04.851624 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845983    2571 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:10:04.851624 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845986    2571 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:10:04.851624 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845989    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:10:04.851624 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845991    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:10:04.851624 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845994    2571 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:10:04.851624 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845997    2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:10:04.851624 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.845999    2571 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:10:04.851624 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846002    2571 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:10:04.851624 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846005    2571 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:10:04.852107 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846007    2571 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:10:04.852107 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846010    2571 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:10:04.852107 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846012    2571 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:10:04.852107 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846015    2571 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:10:04.852107 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846018    2571 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:10:04.852107 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846020    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:10:04.852107 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846023    2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:10:04.852107 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846027    2571 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:10:04.852107 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846030    2571 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:10:04.852107 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846034    2571 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:10:04.852107 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846038    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:10:04.852107 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846041    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:10:04.852107 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846044    2571 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:10:04.852107 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846046    2571 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:10:04.852107 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846049    2571 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:10:04.852107 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846053    2571 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:10:04.852107 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846055    2571 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:10:04.852107 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846058    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:10:04.852107 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846061    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:10:04.852604 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846063    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:10:04.852604 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846066    2571 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:10:04.852604 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846069    2571 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:10:04.852604 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846071    2571 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:10:04.852604 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846074    2571 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:10:04.852604 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846077    2571 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:10:04.852604 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846079    2571 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:10:04.852604 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846082    2571 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:10:04.852604 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846084    2571 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:10:04.852604 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846087    2571 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:10:04.852604 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846090    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:10:04.852604 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846093    2571 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:10:04.852604 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846096    2571 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:10:04.852604 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846098    2571 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:10:04.852604 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846101    2571 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:10:04.852604 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846103    2571 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:10:04.852604 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846106    2571 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:10:04.852604 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846108    2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:10:04.852604 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846110    2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:10:04.853062 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846113    2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:10:04.853062 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846116    2571 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:10:04.853062 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846118    2571 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:10:04.853062 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846121    2571 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:10:04.853062 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846123    2571 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:10:04.853062 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846127    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:10:04.853062 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846129    2571 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:10:04.853062 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846132    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:10:04.853062 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846134    2571 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:10:04.853062 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846137    2571 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:10:04.853062 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846140    2571 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:10:04.853062 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846143    2571 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:10:04.853062 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846145    2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:10:04.853062 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846148    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:10:04.853062 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846151    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:10:04.853062 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846153    2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:10:04.853062 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846155    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:10:04.853062 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846158    2571 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:10:04.853062 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846160    2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:10:04.853510 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846163    2571 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:10:04.853510 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846166    2571 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:10:04.853510 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846168    2571 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:10:04.853510 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.846194    2571 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 01:10:04.853510 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846341    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:10:04.853510 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846346    2571 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:10:04.853510 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846348    2571 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:10:04.853510 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846351    2571 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:10:04.853510 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846354    2571 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:10:04.853510 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846357    2571 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:10:04.853510 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846359    2571 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:10:04.853510 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846362    2571 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:10:04.853510 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846364    2571 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:10:04.853510 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846367    2571 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:10:04.853510 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846370    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:10:04.853510 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846373    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:10:04.853926 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846376    2571 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:10:04.853926 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846378    2571 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:10:04.853926 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846381    2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:10:04.853926 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846384    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:10:04.853926 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846387    2571 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:10:04.853926 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846389    2571 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:10:04.853926 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846392    2571 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:10:04.853926 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846395    2571 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:10:04.853926 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846398    2571 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:10:04.853926 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846401    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:10:04.853926 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846403    2571 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:10:04.853926 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846406    2571 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:10:04.853926 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846408    2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:10:04.853926 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846411    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:10:04.853926 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846414    2571 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:10:04.853926 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846416    2571 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:10:04.853926 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846419    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:10:04.853926 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846422    2571 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:10:04.853926 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846424    2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:10:04.854438 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846427    2571 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:10:04.854438 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846436    2571 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:10:04.854438 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846439    2571 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:10:04.854438 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846442    2571 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:10:04.854438 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846445    2571 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:10:04.854438 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846447    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:10:04.854438 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846450    2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:10:04.854438 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846452    2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:10:04.854438 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846455    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:10:04.854438 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846457    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:10:04.854438 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846460    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:10:04.854438 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846462    2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:10:04.854438 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846465    2571 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:10:04.854438 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846468    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:10:04.854438 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846470    2571 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:10:04.854438 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846473    2571 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:10:04.854438 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846475    2571 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:10:04.854438 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846479    2571 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:10:04.854438 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846481    2571 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:10:04.855085 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846484    2571 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:10:04.855085 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846487    2571 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:10:04.855085 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846489    2571 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:10:04.855085 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846492    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:10:04.855085 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846494    2571 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:10:04.855085 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846497    2571 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:10:04.855085 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846499    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:10:04.855085 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846502    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:10:04.855085 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846504    2571 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:10:04.855085 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846507    2571 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:10:04.855085 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846510    2571 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:10:04.855085 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846512    2571 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:10:04.855085 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846515    2571 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:10:04.855085 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846517    2571 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:10:04.855085 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846520    2571 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:10:04.855085 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846522    2571 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:10:04.855085 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846525    2571 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:10:04.855085 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846527    2571 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:10:04.855085 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846530    2571 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:10:04.855085 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846532    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:10:04.855553 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846535    2571 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:10:04.855553 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846537    2571 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:10:04.855553 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846540    2571 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:10:04.855553 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846542    2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:10:04.855553 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846545    2571 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:10:04.855553 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846547    2571 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:10:04.855553 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846550    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:10:04.855553 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846552    2571 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:10:04.855553 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846555    2571 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:10:04.855553 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846557    2571 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:10:04.855553 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846560    2571 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:10:04.855553 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846563    2571 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:10:04.855553 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846565    2571 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:10:04.855553 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846570    2571 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:10:04.855553 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846574    2571 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:10:04.855553 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846578    2571 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:10:04.855553 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846580    2571 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:10:04.855553 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846583    2571 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:10:04.855553 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846586    2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:10:04.855553 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846589    2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:10:04.856165 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846592    2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:10:04.856165 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846594    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:10:04.856165 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846597    2571 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:10:04.856165 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846600    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:10:04.856165 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846603    2571 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:10:04.856165 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846605    2571 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:10:04.856165 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846607    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:10:04.856165 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846611    2571 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:10:04.856165 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846614    2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:10:04.856165 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846617    2571 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:10:04.856165 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846620    2571 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:10:04.856165 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846622    2571 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:10:04.856165 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846625    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:10:04.856165 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846628    2571 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:10:04.856165 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846630    2571 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:10:04.856165 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846633    2571 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:10:04.856782 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.846656    2571 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 01:10:04.856782 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846694    2571 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:10:04.856782 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846698    2571 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:10:04.856782 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846701    2571 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:10:04.856782 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846703    2571 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:10:04.856782 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846706    2571 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:10:04.856782 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846709    2571 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:10:04.856782 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846711    2571 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:10:04.856782 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846714    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:10:04.856782 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846717    2571 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:10:04.856782 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846720    2571 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:10:04.856782 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846722    2571 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:10:04.856782 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846725    2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:10:04.856782 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846727    2571 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:10:04.856782 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846730    2571 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:10:04.856782 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846732    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:10:04.857368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846735    2571 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:10:04.857368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846738    2571 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:10:04.857368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846740    2571 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:10:04.857368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846743    2571 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:10:04.857368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846745    2571 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:10:04.857368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846748    2571 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:10:04.857368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846751    2571 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:10:04.857368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846755    2571 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:10:04.857368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846758    2571 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:10:04.857368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846761    2571 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:10:04.857368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846764    2571 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:10:04.857368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846767    2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:10:04.857368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846770    2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:10:04.857368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846773    2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:10:04.857368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846776    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:10:04.857368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846778    2571 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:10:04.857368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846781    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:10:04.857368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846783    2571 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:10:04.857368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846786    2571 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:10:04.857368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846788    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:10:04.857844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846792    2571 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:10:04.857844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846795    2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:10:04.857844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846798    2571 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:10:04.857844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846800    2571 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:10:04.857844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846803    2571 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:10:04.857844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846806    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:10:04.857844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846809    2571 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:10:04.857844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846811    2571 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:10:04.857844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846814    2571 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:10:04.857844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846816    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:10:04.857844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846819    2571 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:10:04.857844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846821    2571 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:10:04.857844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846824    2571 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:10:04.857844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846826    2571 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:10:04.857844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846829    2571 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:10:04.857844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846832    2571 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:10:04.857844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846834    2571 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:10:04.857844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846836    2571 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:10:04.857844 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846839    2571 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:10:04.858368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846841    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:10:04.858368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846844    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:10:04.858368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846846    2571 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:10:04.858368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846849    2571 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:10:04.858368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846851    2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:10:04.858368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846854    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:10:04.858368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846857    2571 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:10:04.858368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846859    2571 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:10:04.858368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846862    2571 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:10:04.858368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846865    2571 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:10:04.858368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846868    2571 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:10:04.858368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846870    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:10:04.858368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846873    2571 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:10:04.858368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846875    2571 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:10:04.858368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846878    2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:10:04.858368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846880    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:10:04.858368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846883    2571 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:10:04.858368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846885    2571 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:10:04.858368 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846888    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:10:04.858818 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846890    2571 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:10:04.858818 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846893    2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:10:04.858818 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846895    2571 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:10:04.858818 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846898    2571 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:10:04.858818 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846900    2571 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:10:04.858818 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846903    2571 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:10:04.858818 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846905    2571 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:10:04.858818 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846908    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:10:04.858818 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846910    2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:10:04.858818 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846913    2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:10:04.858818 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846915    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:10:04.858818 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846918    2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:10:04.858818 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846920    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:10:04.858818 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846923    2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:10:04.858818 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846925    2571 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:10:04.858818 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846928    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:10:04.858818 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846930    2571 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:10:04.858818 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846932    2571 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:10:04.858818 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846937    2571 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:10:04.858818 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846940    2571 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:10:04.859519 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846943    2571 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:10:04.859519 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846945    2571 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:10:04.859519 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846948    2571 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:10:04.859519 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846950    2571 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:10:04.859519 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846953    2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:10:04.859519 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846955    2571 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:10:04.859519 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846958    2571 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:10:04.859519 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846960    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:10:04.859519 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846963    2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:10:04.859519 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846979    2571 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:10:04.859519 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846983    2571 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:10:04.859519 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846988    2571 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:10:04.859519 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:04.846990    2571 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:10:04.859519 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.847040    2571 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 04 01:10:04.859519 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.849174    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Nov 04 01:10:04.859519 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.850323    2571 server.go:1014] "Starting client certificate rotation"
Nov 04 01:10:04.859519 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.850417    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 01:10:04.859519 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.850463    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 01:10:04.860098 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.852510    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 01:10:04.860098 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.856999    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 01:10:04.868923 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.868908    2571 log.go:25] "Validated CRI v1 runtime API"
Nov 04 01:10:04.872524 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.872509    2571 log.go:25] "Validated CRI v1 image API"
Nov 04 01:10:04.873383 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.873355    2571 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 04 01:10:04.878980 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.878952    2571 fs.go:135] Filesystem UUIDs: map[63eddd5d-72a2-40e9-8274-8816d2d8331b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ecda85b3-ab5c-4a67-9088-dc4a5fa6822c:/dev/nvme0n1p3]
Nov 04 01:10:04.879043 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.878983    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Nov 04 01:10:04.884283 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.884170    2571 manager.go:217] Machine: {Timestamp:2026-11-04 01:10:04.882818448 +0000 UTC m=+0.374367051 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100023 MemoryCapacity:33164337152 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec279bf0c982f8bf5c44f9e96b4b6ca6 SystemUUID:ec279bf0-c982-f8bf-5c44-f9e96b4b6ca6 BootID:862db6b0-b2dc-4098-a58f-0c976163f770 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:06:ff:d6:56:22:e1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:06:ff:d6:56:22:e1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:36:cd:39:10:a4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164337152 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 04 01:10:04.884852 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.884842    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 04 01:10:04.884937 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.884921    2571 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 04 01:10:04.887709 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.887684    2571 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 04 01:10:04.887844 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.887711    2571 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-51.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 04 01:10:04.887886 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.887846    2571 topology_manager.go:143] "Creating topology manager with none policy"
Nov 04 01:10:04.887886 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.887854    2571 container_manager_linux.go:311] "Creating device plugin manager"
Nov 04 01:10:04.887934 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.887886    2571 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 01:10:04.887934 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.887904    2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 01:10:04.889097 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.889086    2571 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 04 01:10:04.893341 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.893330    2571 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 04 01:10:04.893456 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.893447    2571 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 04 01:10:04.894544 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.894534    2571 kubelet.go:493] "Attempting to sync node with API server"
Nov 04 01:10:04.894578 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.894546    2571 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 04 01:10:04.894578 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.894556    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 04 01:10:04.894578 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.894564    2571 kubelet.go:405] "Adding apiserver pod source"
Nov 04 01:10:04.894578 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.894572    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 04 01:10:04.894920 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.894901    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 01:10:04.898697 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.898676    2571 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 04 01:10:04.905100 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.905086    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 01:10:04.906077 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.906065    2571 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 04 01:10:04.906114 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.906095    2571 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 04 01:10:04.906250 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.906240    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 04 01:10:04.906297 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.906255    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 04 01:10:04.906297 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.906262    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 04 01:10:04.906297 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.906267    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 04 01:10:04.906297 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.906273    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 04 01:10:04.906297 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.906278    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 04 01:10:04.906914 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.906905    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 04 01:10:04.906943 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.906915    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 04 01:10:04.906943 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.906922    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 04 01:10:04.906943 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.906928    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 04 01:10:04.906943 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.906937    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 04 01:10:04.907118 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.906945    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 04 01:10:04.907685 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.907676    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 04 01:10:04.907685 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.907685    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 04 01:10:04.911350 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.911336    2571 server.go:1263] "Started kubelet"
Nov 04 01:10:04.911456 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.911420    2571 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 04 01:10:04.911533 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.911452    2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 04 01:10:04.911569 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.911558    2571 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 04 01:10:04.911936 ip-10-0-131-51 systemd[1]: Started Kubernetes Kubelet.
Nov 04 01:10:04.913202 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.913131    2571 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 04 01:10:04.914646 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.914635    2571 server.go:317] "Adding debug handlers to kubelet server"
Nov 04 01:10:04.919150 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:04.919127    2571 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Nov 04 01:10:04.919418 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.919399    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 04 01:10:04.920570 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.920554    2571 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 04 01:10:04.920664 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:04.920649    2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-51.us-west-2.compute.internal\" not found"
Nov 04 01:10:04.921309 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.921265    2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 04 01:10:04.921309 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.921267    2571 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 04 01:10:04.921309 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.921292    2571 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 04 01:10:04.921504 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.921382    2571 reconstruct.go:97] "Volume reconstruction finished"
Nov 04 01:10:04.921504 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.921389    2571 reconciler.go:29] "Reconciler: start to sync state"
Nov 04 01:10:04.921504 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.921405    2571 factory.go:153] Registering CRI-O factory
Nov 04 01:10:04.921504 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.921418    2571 factory.go:223] Registration of the crio container factory successfully
Nov 04 01:10:04.921504 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.921464    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 04 01:10:04.921504 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.921473    2571 factory.go:55] Registering systemd factory
Nov 04 01:10:04.921504 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.921481    2571 factory.go:223] Registration of the systemd container factory successfully
Nov 04 01:10:04.921504 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.921498    2571 factory.go:103] Registering Raw factory
Nov 04 01:10:04.921738 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.921513    2571 manager.go:1199] Started watching for new ooms in manager
Nov 04 01:10:04.922540 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.922526    2571 manager.go:319] Starting recovery of all containers
Nov 04 01:10:04.932937 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.932920    2571 manager.go:324] Recovery completed
Nov 04 01:10:04.938671 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.938657    2571 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 01:10:04.941235 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.941216    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 01:10:04.941321 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.941248    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 01:10:04.941321 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.941282    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 01:10:04.941832 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.941817    2571 cpu_manager.go:226] "Starting" policy="none"
Nov 04 01:10:04.941832 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.941828    2571 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 01:10:04.941993 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.941829    2571 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 04 01:10:04.941993 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.941870    2571 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 04 01:10:04.942567 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.942549    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 01:10:04.942631 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.942579    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 01:10:04.942631 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.942592    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 01:10:04.944096 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.944084    2571 policy_none.go:50] "Start"
Nov 04 01:10:04.944145 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.944113    2571 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 04 01:10:04.944145 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.944124    2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 04 01:10:04.946121 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.946107    2571 policy_none.go:44] "Start"
Nov 04 01:10:04.974597 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.974572    2571 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 04 01:10:04.977278 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.977265    2571 manager.go:341] "Starting Device Plugin manager"
Nov 04 01:10:04.977364 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:04.977296    2571 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 04 01:10:04.977364 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.977308    2571 server.go:87] "Starting device plugin registration server"
Nov 04 01:10:04.977547 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.977534    2571 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 04 01:10:04.977603 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.977549    2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 04 01:10:04.977688 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.977670    2571 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 04 01:10:04.977778 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.977764    2571 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 04 01:10:04.977854 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:04.977779    2571 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 04 01:10:04.978243 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:04.978219    2571 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 04 01:10:04.978340 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:04.978275    2571 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-51.us-west-2.compute.internal\" not found"
Nov 04 01:10:05.045588 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.045565    2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-51.us-west-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Nov 04 01:10:05.045588 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:05.045574    2571 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-51.us-west-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Nov 04 01:10:05.047335 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:05.045554    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-51.us-west-2.compute.internal.18e4b24f37f5b3cf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-51.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-51.us-west-2.compute.internal,},FirstTimestamp:2026-11-04 01:10:04.911309775 +0000 UTC m=+0.402858376,LastTimestamp:2026-11-04 01:10:04.911309775 +0000 UTC m=+0.402858376,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-51.us-west-2.compute.internal,}"
Nov 04 01:10:05.068064 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.068035    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 04 01:10:05.069191 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.069170    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 04 01:10:05.069329 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.069193    2571 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 04 01:10:05.069329 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.069215    2571 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 04 01:10:05.069329 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:05.069251    2571 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Nov 04 01:10:05.077809 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.077791    2571 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 01:10:05.080006 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.079960    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 01:10:05.080006 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.080000    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 01:10:05.080089 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.080010    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 01:10:05.080089 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.080031    2571 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:10:05.106726 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:05.106545    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-51.us-west-2.compute.internal.18e4b24f39be4ec4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-51.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-51.us-west-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-51.us-west-2.compute.internal,},FirstTimestamp:2026-11-04 01:10:04.94123386 +0000 UTC m=+0.432782465,LastTimestamp:2026-11-04 01:10:04.94123386 +0000 UTC m=+0.432782465,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-51.us-west-2.compute.internal,}"
Nov 04 01:10:05.107150 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:05.107119    2571 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Nov 04 01:10:05.107150 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:05.107117    2571 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-51.us-west-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Nov 04 01:10:05.107265 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:05.107118    2571 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Nov 04 01:10:05.116717 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.116702    2571 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 04 01:10:05.116803 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.116745    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f2t85"
Nov 04 01:10:05.170177 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.170152    2571 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal"]
Nov 04 01:10:05.170269 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.170202    2571 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 01:10:05.170946 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.170930    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 01:10:05.171012 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.170957    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 01:10:05.171012 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.170982    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 01:10:05.172863 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.172851    2571 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 01:10:05.173015 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.173002    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:10:05.173055 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.173040    2571 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 01:10:05.173604 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.173583    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 01:10:05.173690 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.173607    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 01:10:05.173690 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.173617    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 01:10:05.173690 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.173628    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 01:10:05.173690 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.173638    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 01:10:05.173690 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.173629    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 01:10:05.175438 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.175421    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:10:05.175522 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.175446    2571 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 01:10:05.176234 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.176221    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 01:10:05.176323 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.176247    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 01:10:05.176323 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.176261    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 01:10:05.200055 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:05.200038    2571 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-51.us-west-2.compute.internal\" not found" node="ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:10:05.201123 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.201110    2571 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 01:10:05.201950 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:05.201935    2571 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-51.us-west-2.compute.internal\" not found" node="ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:10:05.207496 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.207480    2571 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:10:05.207580 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:05.207504    2571 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-51.us-west-2.compute.internal\": node \"ip-10-0-131-51.us-west-2.compute.internal\" not found"
Nov 04 01:10:05.223823 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.223803    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a8e9fbe3308d7a9dc37557b42c180c40-config\") pod \"kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal\" (UID: \"a8e9fbe3308d7a9dc37557b42c180c40\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:10:05.223892 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.223828    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f2aa811e393ce1519559d6514adffb05-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal\" (UID: \"f2aa811e393ce1519559d6514adffb05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:10:05.223892 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.223845    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2aa811e393ce1519559d6514adffb05-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal\" (UID: \"f2aa811e393ce1519559d6514adffb05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:10:05.319653 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:05.319631    2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-51.us-west-2.compute.internal\" not found"
Nov 04 01:10:05.324880 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.324866    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2aa811e393ce1519559d6514adffb05-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal\" (UID: \"f2aa811e393ce1519559d6514adffb05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:10:05.324939 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.324888    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a8e9fbe3308d7a9dc37557b42c180c40-config\") pod \"kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal\" (UID: \"a8e9fbe3308d7a9dc37557b42c180c40\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:10:05.324939 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.324902    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f2aa811e393ce1519559d6514adffb05-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal\" (UID: \"f2aa811e393ce1519559d6514adffb05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:10:05.324939 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.324926    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f2aa811e393ce1519559d6514adffb05-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal\" (UID: \"f2aa811e393ce1519559d6514adffb05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:10:05.325070 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.324942    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a8e9fbe3308d7a9dc37557b42c180c40-config\") pod \"kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal\" (UID: \"a8e9fbe3308d7a9dc37557b42c180c40\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:10:05.325070 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.324955    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2aa811e393ce1519559d6514adffb05-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal\" (UID: \"f2aa811e393ce1519559d6514adffb05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:10:05.419983 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:05.419924    2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-51.us-west-2.compute.internal\" not found"
Nov 04 01:10:05.504538 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.504521    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:10:05.506591 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.506577    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:10:05.520358 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:05.520340    2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-51.us-west-2.compute.internal\" not found"
Nov 04 01:10:05.621134 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:05.621105    2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-51.us-west-2.compute.internal\" not found"
Nov 04 01:10:05.722518 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:05.722482    2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-51.us-west-2.compute.internal\" not found"
Nov 04 01:10:05.823570 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:05.823538    2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-51.us-west-2.compute.internal\" not found"
Nov 04 01:10:05.850629 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.850611    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Nov 04 01:10:05.851027 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:05.850792    2571 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 04 01:10:05.851027 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:05.850769    2571 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a3e660436c5ac4b748d5d3f99dae8da8-e741eb2aa4dd6e95.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-131-51.us-west-2.compute.internal.18e4b24f39be9ce4\": read tcp 10.0.131.51:32848->3.147.153.216:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-131-51.us-west-2.compute.internal.18e4b24f39be9ce4  default   5498 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-51.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-51.us-west-2.compute.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-51.us-west-2.compute.internal,},FirstTimestamp:2026-11-04 01:10:04 +0000 UTC,LastTimestamp:2026-11-04 01:10:05.170961458 +0000 UTC m=+0.662510059,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-51.us-west-2.compute.internal,}"
Nov 04 01:10:05.923780 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:05.923731    2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-51.us-west-2.compute.internal\" not found"
Nov 04 01:10:06.024570 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:06.024550    2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-51.us-west-2.compute.internal\" not found"
Nov 04 01:10:06.121898 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:06.121861    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 01:05:05 +0000 UTC" deadline="2028-04-13 17:49:21.198884411 +0000 UTC"
Nov 04 01:10:06.121898 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:06.121892    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12640h39m15.076997179s"
Nov 04 01:10:06.125263 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:06.125248    2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-51.us-west-2.compute.internal\" not found"
Nov 04 01:10:06.225483 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:06.225430    2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-51.us-west-2.compute.internal\" not found"
Nov 04 01:10:06.246086 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:06.246059    2571 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 01:10:06.247036 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:06.247022    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 01:10:06.247105 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:06.247053    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 01:10:06.247105 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:06.247068    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 01:10:06.326424 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:06.326400    2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-51.us-west-2.compute.internal\" not found"
Nov 04 01:10:06.344364 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:06.344347    2571 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 01:10:06.344474 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:06.344446    2571 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 01:10:06.427464 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:06.427440    2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-51.us-west-2.compute.internal\" not found"
Nov 04 01:10:06.528434 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:06.528372    2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-51.us-west-2.compute.internal\" not found"
Nov 04 01:10:06.629376 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:06.629346    2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-51.us-west-2.compute.internal\" not found"
Nov 04 01:10:06.696071 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:06.696047    2571 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 01:10:06.720891 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:06.720872    2571 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:10:06.721135 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:06.721101    2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2aa811e393ce1519559d6514adffb05.slice/crio-caa3d106e523f500050b2ce2c243d91398b475c5456130fd52d6b07324c37371 WatchSource:0}: Error finding container caa3d106e523f500050b2ce2c243d91398b475c5456130fd52d6b07324c37371: Status 404 returned error can't find the container with id caa3d106e523f500050b2ce2c243d91398b475c5456130fd52d6b07324c37371
Nov 04 01:10:06.728213 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:06.728197    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 01:10:06.730444 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:06.730421    2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e9fbe3308d7a9dc37557b42c180c40.slice/crio-b37230d2516bdf52e266bef05d202602417fd93cb7881baeac3234c87afe7741 WatchSource:0}: Error finding container b37230d2516bdf52e266bef05d202602417fd93cb7881baeac3234c87afe7741: Status 404 returned error can't find the container with id b37230d2516bdf52e266bef05d202602417fd93cb7881baeac3234c87afe7741
Nov 04 01:10:06.790795 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:06.790744    2571 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 01:10:06.791760 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:06.791747    2571 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:10:06.860263 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:06.860246    2571 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 01:10:06.897561 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:06.897543    2571 apiserver.go:52] "Watching apiserver"
Nov 04 01:10:06.921188 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:06.921170    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Nov 04 01:10:07.015292 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.015268    2571 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 04 01:10:07.015579 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.015561    2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-7q5cg","openshift-image-registry/node-ca-n8xrm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal","openshift-network-diagnostics/network-check-target-zq545","openshift-ovn-kubernetes/ovnkube-node-4glcp","kube-system/global-pull-secret-syncer-nrlb9","kube-system/konnectivity-agent-vktnk","openshift-dns/node-resolver-dzffv","openshift-multus/multus-additional-cni-plugins-25q95","openshift-multus/multus-h9lvw","openshift-network-operator/iptables-alerter-jz7tt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft","openshift-multus/network-metrics-daemon-fq4qm","kube-system/kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal"]
Nov 04 01:10:07.019343 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.019324    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vktnk"
Nov 04 01:10:07.021637 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.021622    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:07.021713 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:07.021680    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fq4qm" podUID="96855631-beca-4d91-814d-689668f6de56"
Nov 04 01:10:07.023887 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.023871    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dzffv"
Nov 04 01:10:07.026250 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.026230    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:07.026342 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:07.026281    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zq545" podUID="2db16eff-7518-4f50-b080-8208d5e756cc"
Nov 04 01:10:07.028734 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.028712    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.031173 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.031152    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:07.031252 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:07.031225    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nrlb9" podUID="42e12e95-3cc8-4393-93fb-087e19f92874"
Nov 04 01:10:07.035344 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.035324    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/39732b86-9f58-44ea-925e-a5e45c676586-konnectivity-ca\") pod \"konnectivity-agent-vktnk\" (UID: \"39732b86-9f58-44ea-925e-a5e45c676586\") " pod="kube-system/konnectivity-agent-vktnk"
Nov 04 01:10:07.035441 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.035350    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfl4s\" (UniqueName: \"kubernetes.io/projected/96855631-beca-4d91-814d-689668f6de56-kube-api-access-sfl4s\") pod \"network-metrics-daemon-fq4qm\" (UID: \"96855631-beca-4d91-814d-689668f6de56\") " pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:07.035441 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.035367    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c242f2eb-7d62-4990-84b0-04175eefc461-hosts-file\") pod \"node-resolver-dzffv\" (UID: \"c242f2eb-7d62-4990-84b0-04175eefc461\") " pod="openshift-dns/node-resolver-dzffv"
Nov 04 01:10:07.035441 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.035382    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c242f2eb-7d62-4990-84b0-04175eefc461-tmp-dir\") pod \"node-resolver-dzffv\" (UID: \"c242f2eb-7d62-4990-84b0-04175eefc461\") " pod="openshift-dns/node-resolver-dzffv"
Nov 04 01:10:07.035441 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.035405    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/39732b86-9f58-44ea-925e-a5e45c676586-agent-certs\") pod \"konnectivity-agent-vktnk\" (UID: \"39732b86-9f58-44ea-925e-a5e45c676586\") " pod="kube-system/konnectivity-agent-vktnk"
Nov 04 01:10:07.035601 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.035455    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs\") pod \"network-metrics-daemon-fq4qm\" (UID: \"96855631-beca-4d91-814d-689668f6de56\") " pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:07.035601 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.035494    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpqvm\" (UniqueName: \"kubernetes.io/projected/c242f2eb-7d62-4990-84b0-04175eefc461-kube-api-access-wpqvm\") pod \"node-resolver-dzffv\" (UID: \"c242f2eb-7d62-4990-84b0-04175eefc461\") " pod="openshift-dns/node-resolver-dzffv"
Nov 04 01:10:07.038340 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.038323    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:10:07.040146 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.040129    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.042246 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.042204    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n8xrm"
Nov 04 01:10:07.044331 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.044307    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.046411 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.046391    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jz7tt"
Nov 04 01:10:07.048585 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.048567    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:10:07.072917 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.072879    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal" event={"ID":"a8e9fbe3308d7a9dc37557b42c180c40","Type":"ContainerStarted","Data":"b37230d2516bdf52e266bef05d202602417fd93cb7881baeac3234c87afe7741"}
Nov 04 01:10:07.074260 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.074238    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal" event={"ID":"f2aa811e393ce1519559d6514adffb05","Type":"ContainerStarted","Data":"caa3d106e523f500050b2ce2c243d91398b475c5456130fd52d6b07324c37371"}
Nov 04 01:10:07.079466 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.079445    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 04 01:10:07.079559 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.079457    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 04 01:10:07.079658 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.079558    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-7mrtt\""
Nov 04 01:10:07.083774 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.083757    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 04 01:10:07.083862 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.083851    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 04 01:10:07.083944 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.083926    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hz84q\""
Nov 04 01:10:07.124380 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.124361    2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 04 01:10:07.133828 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.133809    2571 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 04 01:10:07.133896 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.133843    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zt2m8"
Nov 04 01:10:07.135726 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.135707    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-var-lib-cni-bin\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.135804 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.135733    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4fc117ae-0111-4ce2-9676-f125a8b64be9-multus-daemon-config\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.135804 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.135748    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/51c03abc-b77b-4b72-a707-293e13734fae-env-overrides\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.135804 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.135764    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-system-cni-dir\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:10:07.135804 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.135781    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-cnibin\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.135971 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.135824    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-run\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.135971 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.135865    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf440cad-3487-46a5-9d2d-4badf508cbe1-tmp\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.135971 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.135883    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm54c\" (UniqueName: \"kubernetes.io/projected/cf440cad-3487-46a5-9d2d-4badf508cbe1-kube-api-access-nm54c\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.135971 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.135938    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c5a2182-4c90-4ceb-b983-e7428f3a40be-host-slash\") pod \"iptables-alerter-jz7tt\" (UID: \"9c5a2182-4c90-4ceb-b983-e7428f3a40be\") " pod="openshift-network-operator/iptables-alerter-jz7tt"
Nov 04 01:10:07.136205 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.135992    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/51c03abc-b77b-4b72-a707-293e13734fae-ovnkube-script-lib\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.136205 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136028    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfl4s\" (UniqueName: \"kubernetes.io/projected/96855631-beca-4d91-814d-689668f6de56-kube-api-access-sfl4s\") pod \"network-metrics-daemon-fq4qm\" (UID: \"96855631-beca-4d91-814d-689668f6de56\") " pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:07.136205 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136055    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-socket-dir\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:10:07.136205 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136081    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/42e12e95-3cc8-4393-93fb-087e19f92874-kubelet-config\") pod \"global-pull-secret-syncer-nrlb9\" (UID: \"42e12e95-3cc8-4393-93fb-087e19f92874\") " pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:07.136205 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136106    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/42e12e95-3cc8-4393-93fb-087e19f92874-dbus\") pod \"global-pull-secret-syncer-nrlb9\" (UID: \"42e12e95-3cc8-4393-93fb-087e19f92874\") " pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:07.136205 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136133    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-kubernetes\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.136205 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136156    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-host\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.136444 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136221    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c5a2182-4c90-4ceb-b983-e7428f3a40be-iptables-alerter-script\") pod \"iptables-alerter-jz7tt\" (UID: \"9c5a2182-4c90-4ceb-b983-e7428f3a40be\") " pod="openshift-network-operator/iptables-alerter-jz7tt"
Nov 04 01:10:07.136444 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136254    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/39732b86-9f58-44ea-925e-a5e45c676586-agent-certs\") pod \"konnectivity-agent-vktnk\" (UID: \"39732b86-9f58-44ea-925e-a5e45c676586\") " pod="kube-system/konnectivity-agent-vktnk"
Nov 04 01:10:07.136444 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136288    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09213485-c715-420e-ab7d-c6cc3ee149a5-host\") pod \"node-ca-n8xrm\" (UID: \"09213485-c715-420e-ab7d-c6cc3ee149a5\") " pod="openshift-image-registry/node-ca-n8xrm"
Nov 04 01:10:07.136444 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136304    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-device-dir\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:10:07.136444 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136323    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqj94\" (UniqueName: \"kubernetes.io/projected/51c03abc-b77b-4b72-a707-293e13734fae-kube-api-access-lqj94\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.136444 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136366    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-sysctl-conf\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.136444 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136407    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-cnibin\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:10:07.136744 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136443    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-tuning-conf-dir\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:10:07.136744 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136465    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/39732b86-9f58-44ea-925e-a5e45c676586-konnectivity-ca\") pod \"konnectivity-agent-vktnk\" (UID: \"39732b86-9f58-44ea-925e-a5e45c676586\") " pod="kube-system/konnectivity-agent-vktnk"
Nov 04 01:10:07.136744 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136481    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-registration-dir\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:10:07.136744 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136500    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-var-lib-openvswitch\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.136744 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136550    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-log-socket\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.136744 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136569    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpqvm\" (UniqueName: \"kubernetes.io/projected/c242f2eb-7d62-4990-84b0-04175eefc461-kube-api-access-wpqvm\") pod \"node-resolver-dzffv\" (UID: \"c242f2eb-7d62-4990-84b0-04175eefc461\") " pod="openshift-dns/node-resolver-dzffv"
Nov 04 01:10:07.136744 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136579    2571 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 04 01:10:07.136744 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136603    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-cni-bin\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.136744 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136631    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-run-multus-certs\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.136744 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136656    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c242f2eb-7d62-4990-84b0-04175eefc461-hosts-file\") pod \"node-resolver-dzffv\" (UID: \"c242f2eb-7d62-4990-84b0-04175eefc461\") " pod="openshift-dns/node-resolver-dzffv"
Nov 04 01:10:07.136744 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136687    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4fc117ae-0111-4ce2-9676-f125a8b64be9-cni-binary-copy\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.136744 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136728    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c242f2eb-7d62-4990-84b0-04175eefc461-hosts-file\") pod \"node-resolver-dzffv\" (UID: \"c242f2eb-7d62-4990-84b0-04175eefc461\") " pod="openshift-dns/node-resolver-dzffv"
Nov 04 01:10:07.136744 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136747    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-cni-netd\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.137392 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136766    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-sysconfig\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.137392 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136783    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-lib-modules\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.137392 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136800    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqhvd\" (UniqueName: \"kubernetes.io/projected/9c5a2182-4c90-4ceb-b983-e7428f3a40be-kube-api-access-nqhvd\") pod \"iptables-alerter-jz7tt\" (UID: \"9c5a2182-4c90-4ceb-b983-e7428f3a40be\") " pod="openshift-network-operator/iptables-alerter-jz7tt"
Nov 04 01:10:07.137392 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136831    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-run-netns\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.137392 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136858    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-var-lib-cni-multus\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.137392 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136874    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-sys-fs\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:10:07.137392 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136896    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-run-ovn-kubernetes\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.137392 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136928    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-var-lib-kubelet\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.137392 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136943    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56tjz\" (UniqueName: \"kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz\") pod \"network-check-target-zq545\" (UID: \"2db16eff-7518-4f50-b080-8208d5e756cc\") " pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:07.137392 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.136965    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c242f2eb-7d62-4990-84b0-04175eefc461-tmp-dir\") pod \"node-resolver-dzffv\" (UID: \"c242f2eb-7d62-4990-84b0-04175eefc461\") " pod="openshift-dns/node-resolver-dzffv"
Nov 04 01:10:07.137392 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137025    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-multus-cni-dir\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.137392 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137042    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-hostroot\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.137392 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137059    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-run-systemd\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.137392 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137081    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:10:07.137392 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137113    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/39732b86-9f58-44ea-925e-a5e45c676586-konnectivity-ca\") pod \"konnectivity-agent-vktnk\" (UID: \"39732b86-9f58-44ea-925e-a5e45c676586\") " pod="kube-system/konnectivity-agent-vktnk"
Nov 04 01:10:07.137392 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137115    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjg74\" (UniqueName: \"kubernetes.io/projected/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-kube-api-access-tjg74\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:10:07.137930 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137187    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-etc-openvswitch\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.137930 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137216    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-run-openvswitch\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.137930 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137245    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.137930 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137275    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c242f2eb-7d62-4990-84b0-04175eefc461-tmp-dir\") pod \"node-resolver-dzffv\" (UID: \"c242f2eb-7d62-4990-84b0-04175eefc461\") " pod="openshift-dns/node-resolver-dzffv"
Nov 04 01:10:07.137930 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137278    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxqmf\" (UniqueName: \"kubernetes.io/projected/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-kube-api-access-lxqmf\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:10:07.137930 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137328    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-slash\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.137930 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137364    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/51c03abc-b77b-4b72-a707-293e13734fae-ovn-node-metrics-cert\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.137930 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137382    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-etc-kubernetes\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.137930 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137398    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2chjr\" (UniqueName: \"kubernetes.io/projected/09213485-c715-420e-ab7d-c6cc3ee149a5-kube-api-access-2chjr\") pod \"node-ca-n8xrm\" (UID: \"09213485-c715-420e-ab7d-c6cc3ee149a5\") " pod="openshift-image-registry/node-ca-n8xrm"
Nov 04 01:10:07.137930 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137426    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/09213485-c715-420e-ab7d-c6cc3ee149a5-serviceca\") pod \"node-ca-n8xrm\" (UID: \"09213485-c715-420e-ab7d-c6cc3ee149a5\") " pod="openshift-image-registry/node-ca-n8xrm"
Nov 04 01:10:07.137930 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137441    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-multus-socket-dir-parent\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.137930 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137454    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-multus-conf-dir\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.137930 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137475    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:10:07.137930 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137505    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs\") pod \"network-metrics-daemon-fq4qm\" (UID: \"96855631-beca-4d91-814d-689668f6de56\") " pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:07.137930 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137525    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-run-netns\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.137930 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137540    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/51c03abc-b77b-4b72-a707-293e13734fae-ovnkube-config\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.138417 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137555    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-systemd\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.138417 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137574    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-run-k8s-cni-cncf-io\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.138417 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:07.137578    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:10:07.138417 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137594    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-kubelet\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.138417 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:07.137631    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs podName:96855631-beca-4d91-814d-689668f6de56 nodeName:}" failed. No retries permitted until 2026-11-04 01:10:07.63761693 +0000 UTC m=+3.129165550 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs") pod "network-metrics-daemon-fq4qm" (UID: "96855631-beca-4d91-814d-689668f6de56") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:10:07.138417 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137655    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-sys\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.138417 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137692    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-tuned\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.138417 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137732    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:10:07.138417 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137765    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-systemd-units\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.138417 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137791    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-modprobe-d\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.138417 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137815    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-cni-binary-copy\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:10:07.138417 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137839    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:10:07.138417 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137872    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt2dh\" (UniqueName: \"kubernetes.io/projected/4fc117ae-0111-4ce2-9676-f125a8b64be9-kube-api-access-pt2dh\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.138417 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137904    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-run-ovn\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.138417 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137922    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret\") pod \"global-pull-secret-syncer-nrlb9\" (UID: \"42e12e95-3cc8-4393-93fb-087e19f92874\") " pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:07.138417 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137937    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-system-cni-dir\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.138881 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137951    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-var-lib-kubelet\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.138881 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.137993    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-node-log\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.138881 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.138024    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-sysctl-d\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.140225 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.140207    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/39732b86-9f58-44ea-925e-a5e45c676586-agent-certs\") pod \"konnectivity-agent-vktnk\" (UID: \"39732b86-9f58-44ea-925e-a5e45c676586\") " pod="kube-system/konnectivity-agent-vktnk"
Nov 04 01:10:07.188552 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.188532    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 04 01:10:07.188662 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.188646    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 04 01:10:07.188717 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.188678    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 04 01:10:07.188927 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.188888    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 04 01:10:07.188927 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.188926    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 04 01:10:07.189077 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.188934    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 04 01:10:07.189077 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.188953    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 04 01:10:07.189189 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.189152    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 04 01:10:07.189189 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.189170    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 04 01:10:07.189372 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.189346    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 04 01:10:07.189531 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.189373    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 04 01:10:07.189531 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.189377    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 04 01:10:07.189531 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.189378    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 04 01:10:07.189531 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.189397    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 04 01:10:07.189531 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.189440    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q5jlj\""
Nov 04 01:10:07.189531 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.189449    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-rjcnb\""
Nov 04 01:10:07.189531 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.189453    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j9t67\""
Nov 04 01:10:07.189531 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.189488    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 04 01:10:07.189531 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.189492    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 04 01:10:07.189531 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.189504    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4z2qg\""
Nov 04 01:10:07.189531 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.189509    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 04 01:10:07.189531 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.189492    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 04 01:10:07.189531 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.189536    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 04 01:10:07.189947 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.189542    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 04 01:10:07.189947 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.189537    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 04 01:10:07.189947 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.189531    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 04 01:10:07.189947 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.189555    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d8jdw\""
Nov 04 01:10:07.189947 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.189564    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g9sbp\""
Nov 04 01:10:07.189947 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.189590    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-prqm6\""
Nov 04 01:10:07.189947 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.189609    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 04 01:10:07.205096 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.205068    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpqvm\" (UniqueName: \"kubernetes.io/projected/c242f2eb-7d62-4990-84b0-04175eefc461-kube-api-access-wpqvm\") pod \"node-resolver-dzffv\" (UID: \"c242f2eb-7d62-4990-84b0-04175eefc461\") " pod="openshift-dns/node-resolver-dzffv"
Nov 04 01:10:07.205171 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.205105    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfl4s\" (UniqueName: \"kubernetes.io/projected/96855631-beca-4d91-814d-689668f6de56-kube-api-access-sfl4s\") pod \"network-metrics-daemon-fq4qm\" (UID: \"96855631-beca-4d91-814d-689668f6de56\") " pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:07.238725 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.238703    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4fc117ae-0111-4ce2-9676-f125a8b64be9-cni-binary-copy\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.238816 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.238726    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-cni-netd\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.238816 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.238742    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-sysconfig\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.238816 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.238757    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-lib-modules\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.238816 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.238805    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-cni-netd\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.239042 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.238842    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-sysconfig\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.239042 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.238916    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-lib-modules\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.239042 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.238966    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqhvd\" (UniqueName: \"kubernetes.io/projected/9c5a2182-4c90-4ceb-b983-e7428f3a40be-kube-api-access-nqhvd\") pod \"iptables-alerter-jz7tt\" (UID: \"9c5a2182-4c90-4ceb-b983-e7428f3a40be\") " pod="openshift-network-operator/iptables-alerter-jz7tt"
Nov 04 01:10:07.239200 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239051    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-run-netns\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.239200 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239083    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-var-lib-cni-multus\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.239200 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239098    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-run-netns\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.239200 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239110    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-sys-fs\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:10:07.239200 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239140    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-run-ovn-kubernetes\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.239200 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239174    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-var-lib-kubelet\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.239200 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239173    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-var-lib-cni-multus\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.239552 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239206    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56tjz\" (UniqueName: \"kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz\") pod \"network-check-target-zq545\" (UID: \"2db16eff-7518-4f50-b080-8208d5e756cc\") " pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:07.239552 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239224    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-run-ovn-kubernetes\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.239552 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239210    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-sys-fs\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:10:07.239552 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239243    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-multus-cni-dir\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.239552 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239293    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-var-lib-kubelet\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.239552 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239345    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-hostroot\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.239552 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239376    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-run-systemd\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.239552 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239408    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-run-systemd\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.239552 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239424    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-hostroot\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.239552 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239438    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:10:07.239552 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239468    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:10:07.239552 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239466    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-multus-cni-dir\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.239552 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239476    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjg74\" (UniqueName: \"kubernetes.io/projected/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-kube-api-access-tjg74\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:10:07.239552 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239522    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-etc-openvswitch\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.239552 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239536    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4fc117ae-0111-4ce2-9676-f125a8b64be9-cni-binary-copy\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.239552 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239562    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-etc-openvswitch\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.240363 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239586    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-run-openvswitch\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.240363 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239618    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.240363 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239651    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-run-openvswitch\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.240363 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239649    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxqmf\" (UniqueName: \"kubernetes.io/projected/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-kube-api-access-lxqmf\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:10:07.240363 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239687    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-slash\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.240363 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239725    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/51c03abc-b77b-4b72-a707-293e13734fae-ovn-node-metrics-cert\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.240363 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239655    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.240363 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239763    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-etc-kubernetes\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.240363 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239774    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-slash\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.240363 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239788    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2chjr\" (UniqueName: \"kubernetes.io/projected/09213485-c715-420e-ab7d-c6cc3ee149a5-kube-api-access-2chjr\") pod \"node-ca-n8xrm\" (UID: \"09213485-c715-420e-ab7d-c6cc3ee149a5\") " pod="openshift-image-registry/node-ca-n8xrm"
Nov 04 01:10:07.240363 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239831    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-etc-kubernetes\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.240363 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239856    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/09213485-c715-420e-ab7d-c6cc3ee149a5-serviceca\") pod \"node-ca-n8xrm\" (UID: \"09213485-c715-420e-ab7d-c6cc3ee149a5\") " pod="openshift-image-registry/node-ca-n8xrm"
Nov 04 01:10:07.240363 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239877    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-multus-socket-dir-parent\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.240363 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239900    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-multus-conf-dir\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.240363 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239914    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:10:07.240363 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240009    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-multus-conf-dir\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.240363 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.239944    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-run-netns\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.241316 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240030    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-multus-socket-dir-parent\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.241316 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240062    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/51c03abc-b77b-4b72-a707-293e13734fae-ovnkube-config\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.241316 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240053    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-run-netns\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.241316 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240082    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:10:07.241316 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240108    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-systemd\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.241316 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240176    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-run-k8s-cni-cncf-io\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.241316 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240192    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-kubelet\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.241316 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240227    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-sys\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.241316 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240303    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-tuned\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.241316 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240312    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-systemd\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.241316 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240334    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-run-k8s-cni-cncf-io\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.241316 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240330    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:10:07.241316 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240374    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-systemd-units\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.241316 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240401    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-modprobe-d\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.241316 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240429    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-cni-binary-copy\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:10:07.241316 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240462    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:10:07.241316 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240474    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-systemd-units\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.242171 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240516    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt2dh\" (UniqueName: \"kubernetes.io/projected/4fc117ae-0111-4ce2-9676-f125a8b64be9-kube-api-access-pt2dh\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.242171 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240546    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-run-ovn\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.242171 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240574    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret\") pod \"global-pull-secret-syncer-nrlb9\" (UID: \"42e12e95-3cc8-4393-93fb-087e19f92874\") " pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:07.242171 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240662    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-system-cni-dir\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.242171 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240703    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-var-lib-kubelet\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.242171 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240842    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-node-log\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.242171 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240882    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-sysctl-d\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.242171 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240902    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-sys\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.242171 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240929    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-var-lib-cni-bin\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.242171 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240950    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/09213485-c715-420e-ab7d-c6cc3ee149a5-serviceca\") pod \"node-ca-n8xrm\" (UID: \"09213485-c715-420e-ab7d-c6cc3ee149a5\") " pod="openshift-image-registry/node-ca-n8xrm"
Nov 04 01:10:07.242171 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.241063    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-kubelet\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.242171 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.241147    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/51c03abc-b77b-4b72-a707-293e13734fae-ovnkube-config\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.242171 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.241157    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-node-log\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.242171 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.240954    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4fc117ae-0111-4ce2-9676-f125a8b64be9-multus-daemon-config\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.242171 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.241233    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-var-lib-cni-bin\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.242171 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.241293    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-var-lib-kubelet\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.242171 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.241336    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-sysctl-d\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.242171 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.241347    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/51c03abc-b77b-4b72-a707-293e13734fae-env-overrides\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.242708 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.241382    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-system-cni-dir\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:10:07.242708 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.241410    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-system-cni-dir\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.242708 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.241424    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-cnibin\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.242708 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.241492    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4fc117ae-0111-4ce2-9676-f125a8b64be9-multus-daemon-config\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.242708 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.241491    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-run-ovn\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.242708 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.241550    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-run\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.242708 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.241581    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf440cad-3487-46a5-9d2d-4badf508cbe1-tmp\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.242708 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.241585    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-cnibin\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.242708 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.241609    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm54c\" (UniqueName: \"kubernetes.io/projected/cf440cad-3487-46a5-9d2d-4badf508cbe1-kube-api-access-nm54c\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.242708 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.241702    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c5a2182-4c90-4ceb-b983-e7428f3a40be-host-slash\") pod \"iptables-alerter-jz7tt\" (UID: \"9c5a2182-4c90-4ceb-b983-e7428f3a40be\") " pod="openshift-network-operator/iptables-alerter-jz7tt"
Nov 04 01:10:07.242708 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.241728    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/51c03abc-b77b-4b72-a707-293e13734fae-ovnkube-script-lib\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.242708 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.241756    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-socket-dir\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:10:07.242708 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.241782    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/42e12e95-3cc8-4393-93fb-087e19f92874-kubelet-config\") pod \"global-pull-secret-syncer-nrlb9\" (UID: \"42e12e95-3cc8-4393-93fb-087e19f92874\") " pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:07.242708 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.241813    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-system-cni-dir\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:10:07.242708 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.241895    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/42e12e95-3cc8-4393-93fb-087e19f92874-kubelet-config\") pod \"global-pull-secret-syncer-nrlb9\" (UID: \"42e12e95-3cc8-4393-93fb-087e19f92874\") " pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:07.242708 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.241859    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:10:07.242708 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.241963    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-modprobe-d\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.243444 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242107    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-socket-dir\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:10:07.243444 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242165    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/51c03abc-b77b-4b72-a707-293e13734fae-env-overrides\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.243444 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242185    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/42e12e95-3cc8-4393-93fb-087e19f92874-dbus\") pod \"global-pull-secret-syncer-nrlb9\" (UID: \"42e12e95-3cc8-4393-93fb-087e19f92874\") " pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:07.243444 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242190    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c5a2182-4c90-4ceb-b983-e7428f3a40be-host-slash\") pod \"iptables-alerter-jz7tt\" (UID: \"9c5a2182-4c90-4ceb-b983-e7428f3a40be\") " pod="openshift-network-operator/iptables-alerter-jz7tt"
Nov 04 01:10:07.243444 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242211    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-run\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.243444 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242243    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-kubernetes\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.243444 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:07.242253    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 01:10:07.243444 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242261    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-host\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.243444 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:07.242309    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret podName:42e12e95-3cc8-4393-93fb-087e19f92874 nodeName:}" failed. No retries permitted until 2026-11-04 01:10:07.742295607 +0000 UTC m=+3.233844212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret") pod "global-pull-secret-syncer-nrlb9" (UID: "42e12e95-3cc8-4393-93fb-087e19f92874") : object "kube-system"/"original-pull-secret" not registered
Nov 04 01:10:07.243444 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242306    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-kubernetes\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.243444 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242324    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c5a2182-4c90-4ceb-b983-e7428f3a40be-iptables-alerter-script\") pod \"iptables-alerter-jz7tt\" (UID: \"9c5a2182-4c90-4ceb-b983-e7428f3a40be\") " pod="openshift-network-operator/iptables-alerter-jz7tt"
Nov 04 01:10:07.243444 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242346    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-host\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.243444 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242401    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/42e12e95-3cc8-4393-93fb-087e19f92874-dbus\") pod \"global-pull-secret-syncer-nrlb9\" (UID: \"42e12e95-3cc8-4393-93fb-087e19f92874\") " pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:07.243444 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242459    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09213485-c715-420e-ab7d-c6cc3ee149a5-host\") pod \"node-ca-n8xrm\" (UID: \"09213485-c715-420e-ab7d-c6cc3ee149a5\") " pod="openshift-image-registry/node-ca-n8xrm"
Nov 04 01:10:07.243444 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242495    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-device-dir\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:10:07.243444 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242523    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqj94\" (UniqueName: \"kubernetes.io/projected/51c03abc-b77b-4b72-a707-293e13734fae-kube-api-access-lqj94\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.243444 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242538    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09213485-c715-420e-ab7d-c6cc3ee149a5-host\") pod \"node-ca-n8xrm\" (UID: \"09213485-c715-420e-ab7d-c6cc3ee149a5\") " pod="openshift-image-registry/node-ca-n8xrm"
Nov 04 01:10:07.244262 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242548    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-sysctl-conf\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.244262 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242565    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-cnibin\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:10:07.244262 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242586    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-tuning-conf-dir\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:10:07.244262 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242607    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-registration-dir\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:10:07.244262 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242528    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-device-dir\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:10:07.244262 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242636    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-var-lib-openvswitch\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.244262 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242674    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-log-socket\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.244262 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242708    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-sysctl-conf\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.244262 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242738    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-cni-bin\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.244262 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242748    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-var-lib-openvswitch\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.244262 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242705    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-cni-bin\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.244262 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242778    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-cnibin\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:10:07.244262 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242790    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-run-multus-certs\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.244262 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242763    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-log-socket\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.244262 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.242803    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-registration-dir\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:10:07.244262 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.243169    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-run-multus-certs\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.244262 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.243264    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-tuning-conf-dir\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:10:07.245014 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.243303    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-tuned\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.245014 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.243409    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/51c03abc-b77b-4b72-a707-293e13734fae-ovn-node-metrics-cert\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.245014 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.243389    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:10:07.245014 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.243452    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-cni-binary-copy\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:10:07.245014 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.243737    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/51c03abc-b77b-4b72-a707-293e13734fae-ovnkube-script-lib\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.246229 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.246210    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf440cad-3487-46a5-9d2d-4badf508cbe1-tmp\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.246653 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.246632    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c5a2182-4c90-4ceb-b983-e7428f3a40be-iptables-alerter-script\") pod \"iptables-alerter-jz7tt\" (UID: \"9c5a2182-4c90-4ceb-b983-e7428f3a40be\") " pod="openshift-network-operator/iptables-alerter-jz7tt"
Nov 04 01:10:07.306094 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:07.306039    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 01:10:07.306094 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:07.306067    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 01:10:07.306094 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:07.306082    2571 projected.go:196] Error preparing data for projected volume kube-api-access-56tjz for pod openshift-network-diagnostics/network-check-target-zq545: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:10:07.306241 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:07.306150    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz podName:2db16eff-7518-4f50-b080-8208d5e756cc nodeName:}" failed. No retries permitted until 2026-11-04 01:10:07.806126156 +0000 UTC m=+3.297674774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-56tjz" (UniqueName: "kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz") pod "network-check-target-zq545" (UID: "2db16eff-7518-4f50-b080-8208d5e756cc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:10:07.308076 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.308050    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqhvd\" (UniqueName: \"kubernetes.io/projected/9c5a2182-4c90-4ceb-b983-e7428f3a40be-kube-api-access-nqhvd\") pod \"iptables-alerter-jz7tt\" (UID: \"9c5a2182-4c90-4ceb-b983-e7428f3a40be\") " pod="openshift-network-operator/iptables-alerter-jz7tt"
Nov 04 01:10:07.309325 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.309300    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxqmf\" (UniqueName: \"kubernetes.io/projected/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-kube-api-access-lxqmf\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:10:07.309608 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.309584    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2chjr\" (UniqueName: \"kubernetes.io/projected/09213485-c715-420e-ab7d-c6cc3ee149a5-kube-api-access-2chjr\") pod \"node-ca-n8xrm\" (UID: \"09213485-c715-420e-ab7d-c6cc3ee149a5\") " pod="openshift-image-registry/node-ca-n8xrm"
Nov 04 01:10:07.309608 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.309594    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt2dh\" (UniqueName: \"kubernetes.io/projected/4fc117ae-0111-4ce2-9676-f125a8b64be9-kube-api-access-pt2dh\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.309608 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.309603    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjg74\" (UniqueName: \"kubernetes.io/projected/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-kube-api-access-tjg74\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:10:07.309864 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.309847    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm54c\" (UniqueName: \"kubernetes.io/projected/cf440cad-3487-46a5-9d2d-4badf508cbe1-kube-api-access-nm54c\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.310978 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.310962    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqj94\" (UniqueName: \"kubernetes.io/projected/51c03abc-b77b-4b72-a707-293e13734fae-kube-api-access-lqj94\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.330135 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.330120    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vktnk"
Nov 04 01:10:07.339447 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.339427    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dzffv"
Nov 04 01:10:07.340913 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:07.340891    2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39732b86_9f58_44ea_925e_a5e45c676586.slice/crio-f8500f73262b59eddca75f848b70f2d3b83021145163058960b0dc0ba07736a7 WatchSource:0}: Error finding container f8500f73262b59eddca75f848b70f2d3b83021145163058960b0dc0ba07736a7: Status 404 returned error can't find the container with id f8500f73262b59eddca75f848b70f2d3b83021145163058960b0dc0ba07736a7
Nov 04 01:10:07.347708 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:07.347687    2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc242f2eb_7d62_4990_84b0_04175eefc461.slice/crio-d2f664120424156696457e59ea652f199d7f932e788d92e24b7e15254bdd53c2 WatchSource:0}: Error finding container d2f664120424156696457e59ea652f199d7f932e788d92e24b7e15254bdd53c2: Status 404 returned error can't find the container with id d2f664120424156696457e59ea652f199d7f932e788d92e24b7e15254bdd53c2
Nov 04 01:10:07.362705 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.362685    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:10:07.366006 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.365988    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:07.367623 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.367608    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n8xrm"
Nov 04 01:10:07.371535 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:07.371509    2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf440cad_3487_46a5_9d2d_4badf508cbe1.slice/crio-4cdc2f2a01d8c8587fe01c7376c7aa878d219770d18b857dc15ad0c3a8e8cadf WatchSource:0}: Error finding container 4cdc2f2a01d8c8587fe01c7376c7aa878d219770d18b857dc15ad0c3a8e8cadf: Status 404 returned error can't find the container with id 4cdc2f2a01d8c8587fe01c7376c7aa878d219770d18b857dc15ad0c3a8e8cadf
Nov 04 01:10:07.373509 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.373489    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h9lvw"
Nov 04 01:10:07.376075 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:07.376056    2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51c03abc_b77b_4b72_a707_293e13734fae.slice/crio-f7d07647e9578409e683b2ffde035906843e842b6509af0778162e73571ce3d9 WatchSource:0}: Error finding container f7d07647e9578409e683b2ffde035906843e842b6509af0778162e73571ce3d9: Status 404 returned error can't find the container with id f7d07647e9578409e683b2ffde035906843e842b6509af0778162e73571ce3d9
Nov 04 01:10:07.377658 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.377643    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:10:07.378315 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:07.378291    2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09213485_c715_420e_ab7d_c6cc3ee149a5.slice/crio-203705501eeff81f21d76b1b64495010efe192f9a39fd9e2a09eb720be6eb994 WatchSource:0}: Error finding container 203705501eeff81f21d76b1b64495010efe192f9a39fd9e2a09eb720be6eb994: Status 404 returned error can't find the container with id 203705501eeff81f21d76b1b64495010efe192f9a39fd9e2a09eb720be6eb994
Nov 04 01:10:07.380328 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.380313    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jz7tt"
Nov 04 01:10:07.382728 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:07.382710    2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fc117ae_0111_4ce2_9676_f125a8b64be9.slice/crio-eabae22ffdb87e7fe5d5dc202a254bbc8df37804387113d66bfedc8de72f9684 WatchSource:0}: Error finding container eabae22ffdb87e7fe5d5dc202a254bbc8df37804387113d66bfedc8de72f9684: Status 404 returned error can't find the container with id eabae22ffdb87e7fe5d5dc202a254bbc8df37804387113d66bfedc8de72f9684
Nov 04 01:10:07.387340 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.387320    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:10:07.388256 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:07.388236    2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af658ed_1cc4_4f7d_b9c8_c0437180bb43.slice/crio-2087462528cfd72c74c36f4d1b132326b44d3906b2a83b7cb8d1ca4a61ef1dd2 WatchSource:0}: Error finding container 2087462528cfd72c74c36f4d1b132326b44d3906b2a83b7cb8d1ca4a61ef1dd2: Status 404 returned error can't find the container with id 2087462528cfd72c74c36f4d1b132326b44d3906b2a83b7cb8d1ca4a61ef1dd2
Nov 04 01:10:07.391089 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:07.391070    2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c5a2182_4c90_4ceb_b983_e7428f3a40be.slice/crio-0f15bf153451982e313c62a87824c6186713b92eef5c1d95cefe8eb8ead95213 WatchSource:0}: Error finding container 0f15bf153451982e313c62a87824c6186713b92eef5c1d95cefe8eb8ead95213: Status 404 returned error can't find the container with id 0f15bf153451982e313c62a87824c6186713b92eef5c1d95cefe8eb8ead95213
Nov 04 01:10:07.393151 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.393122    2571 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 01:10:07.396690 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:07.396669    2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4489ab7f_24b7_4845_aa8c_8344a0bbe5a2.slice/crio-96f7b920c99e1d236fafc58eb209c6b6020848d762518d5752e2729ce671b7c3 WatchSource:0}: Error finding container 96f7b920c99e1d236fafc58eb209c6b6020848d762518d5752e2729ce671b7c3: Status 404 returned error can't find the container with id 96f7b920c99e1d236fafc58eb209c6b6020848d762518d5752e2729ce671b7c3
Nov 04 01:10:07.645534 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.645480    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs\") pod \"network-metrics-daemon-fq4qm\" (UID: \"96855631-beca-4d91-814d-689668f6de56\") " pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:07.645623 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:07.645585    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:10:07.645666 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:07.645636    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs podName:96855631-beca-4d91-814d-689668f6de56 nodeName:}" failed. No retries permitted until 2026-11-04 01:10:08.645623858 +0000 UTC m=+4.137172449 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs") pod "network-metrics-daemon-fq4qm" (UID: "96855631-beca-4d91-814d-689668f6de56") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:10:07.746434 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.746409    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret\") pod \"global-pull-secret-syncer-nrlb9\" (UID: \"42e12e95-3cc8-4393-93fb-087e19f92874\") " pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:07.746534 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:07.746493    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 01:10:07.746534 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:07.746534    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret podName:42e12e95-3cc8-4393-93fb-087e19f92874 nodeName:}" failed. No retries permitted until 2026-11-04 01:10:08.746522039 +0000 UTC m=+4.238070630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret") pod "global-pull-secret-syncer-nrlb9" (UID: "42e12e95-3cc8-4393-93fb-087e19f92874") : object "kube-system"/"original-pull-secret" not registered
Nov 04 01:10:07.847447 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:07.847416    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56tjz\" (UniqueName: \"kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz\") pod \"network-check-target-zq545\" (UID: \"2db16eff-7518-4f50-b080-8208d5e756cc\") " pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:07.847553 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:07.847537    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 01:10:07.847553 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:07.847551    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 01:10:07.847627 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:07.847560    2571 projected.go:196] Error preparing data for projected volume kube-api-access-56tjz for pod openshift-network-diagnostics/network-check-target-zq545: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:10:07.847627 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:07.847603    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz podName:2db16eff-7518-4f50-b080-8208d5e756cc nodeName:}" failed. No retries permitted until 2026-11-04 01:10:08.847588529 +0000 UTC m=+4.339137122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-56tjz" (UniqueName: "kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz") pod "network-check-target-zq545" (UID: "2db16eff-7518-4f50-b080-8208d5e756cc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:10:08.079005 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:08.078906    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7q5cg" event={"ID":"cf440cad-3487-46a5-9d2d-4badf508cbe1","Type":"ContainerStarted","Data":"4cdc2f2a01d8c8587fe01c7376c7aa878d219770d18b857dc15ad0c3a8e8cadf"}
Nov 04 01:10:08.080364 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:08.080333    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dzffv" event={"ID":"c242f2eb-7d62-4990-84b0-04175eefc461","Type":"ContainerStarted","Data":"d2f664120424156696457e59ea652f199d7f932e788d92e24b7e15254bdd53c2"}
Nov 04 01:10:08.081760 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:08.081734    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft" event={"ID":"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2","Type":"ContainerStarted","Data":"96f7b920c99e1d236fafc58eb209c6b6020848d762518d5752e2729ce671b7c3"}
Nov 04 01:10:08.083004 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:08.082967    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jz7tt" event={"ID":"9c5a2182-4c90-4ceb-b983-e7428f3a40be","Type":"ContainerStarted","Data":"0f15bf153451982e313c62a87824c6186713b92eef5c1d95cefe8eb8ead95213"}
Nov 04 01:10:08.084294 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:08.084267    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25q95" event={"ID":"7af658ed-1cc4-4f7d-b9c8-c0437180bb43","Type":"ContainerStarted","Data":"2087462528cfd72c74c36f4d1b132326b44d3906b2a83b7cb8d1ca4a61ef1dd2"}
Nov 04 01:10:08.085663 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:08.085625    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h9lvw" event={"ID":"4fc117ae-0111-4ce2-9676-f125a8b64be9","Type":"ContainerStarted","Data":"eabae22ffdb87e7fe5d5dc202a254bbc8df37804387113d66bfedc8de72f9684"}
Nov 04 01:10:08.087058 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:08.087030    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4glcp" event={"ID":"51c03abc-b77b-4b72-a707-293e13734fae","Type":"ContainerStarted","Data":"f7d07647e9578409e683b2ffde035906843e842b6509af0778162e73571ce3d9"}
Nov 04 01:10:08.088229 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:08.088202    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vktnk" event={"ID":"39732b86-9f58-44ea-925e-a5e45c676586","Type":"ContainerStarted","Data":"f8500f73262b59eddca75f848b70f2d3b83021145163058960b0dc0ba07736a7"}
Nov 04 01:10:08.089301 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:08.089275    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n8xrm" event={"ID":"09213485-c715-420e-ab7d-c6cc3ee149a5","Type":"ContainerStarted","Data":"203705501eeff81f21d76b1b64495010efe192f9a39fd9e2a09eb720be6eb994"}
Nov 04 01:10:08.137023 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:08.136990    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 01:05:07 +0000 UTC" deadline="2028-06-13 21:22:07.036258309 +0000 UTC"
Nov 04 01:10:08.137023 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:08.137023    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14108h11m58.899239993s"
Nov 04 01:10:08.653584 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:08.653542    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs\") pod \"network-metrics-daemon-fq4qm\" (UID: \"96855631-beca-4d91-814d-689668f6de56\") " pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:08.653828 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:08.653745    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:10:08.653828 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:08.653816    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs podName:96855631-beca-4d91-814d-689668f6de56 nodeName:}" failed. No retries permitted until 2026-11-04 01:10:10.653796445 +0000 UTC m=+6.145345053 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs") pod "network-metrics-daemon-fq4qm" (UID: "96855631-beca-4d91-814d-689668f6de56") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:10:08.754583 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:08.754538    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret\") pod \"global-pull-secret-syncer-nrlb9\" (UID: \"42e12e95-3cc8-4393-93fb-087e19f92874\") " pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:08.754792 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:08.754719    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 01:10:08.754792 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:08.754783    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret podName:42e12e95-3cc8-4393-93fb-087e19f92874 nodeName:}" failed. No retries permitted until 2026-11-04 01:10:10.754764328 +0000 UTC m=+6.246312919 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret") pod "global-pull-secret-syncer-nrlb9" (UID: "42e12e95-3cc8-4393-93fb-087e19f92874") : object "kube-system"/"original-pull-secret" not registered
Nov 04 01:10:08.855695 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:08.855656    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56tjz\" (UniqueName: \"kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz\") pod \"network-check-target-zq545\" (UID: \"2db16eff-7518-4f50-b080-8208d5e756cc\") " pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:08.855905 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:08.855818    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 01:10:08.855905 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:08.855842    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 01:10:08.855905 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:08.855855    2571 projected.go:196] Error preparing data for projected volume kube-api-access-56tjz for pod openshift-network-diagnostics/network-check-target-zq545: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:10:08.856126 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:08.855915    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz podName:2db16eff-7518-4f50-b080-8208d5e756cc nodeName:}" failed. No retries permitted until 2026-11-04 01:10:10.855896658 +0000 UTC m=+6.347445254 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-56tjz" (UniqueName: "kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz") pod "network-check-target-zq545" (UID: "2db16eff-7518-4f50-b080-8208d5e756cc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:10:09.070301 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:09.070226    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:09.070466 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:09.070404    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fq4qm" podUID="96855631-beca-4d91-814d-689668f6de56"
Nov 04 01:10:09.070547 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:09.070529    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:09.070654 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:09.070634    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nrlb9" podUID="42e12e95-3cc8-4393-93fb-087e19f92874"
Nov 04 01:10:09.070721 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:09.070707    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:09.070801 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:09.070782    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zq545" podUID="2db16eff-7518-4f50-b080-8208d5e756cc"
Nov 04 01:10:09.137356 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:09.137270    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 01:05:07 +0000 UTC" deadline="2028-06-13 06:13:49.253007926 +0000 UTC"
Nov 04 01:10:09.137356 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:09.137355    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14093h3m40.115657651s"
Nov 04 01:10:10.672280 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:10.672239    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs\") pod \"network-metrics-daemon-fq4qm\" (UID: \"96855631-beca-4d91-814d-689668f6de56\") " pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:10.672914 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:10.672406    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:10:10.672914 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:10.672470    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs podName:96855631-beca-4d91-814d-689668f6de56 nodeName:}" failed. No retries permitted until 2026-11-04 01:10:14.672451687 +0000 UTC m=+10.164000283 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs") pod "network-metrics-daemon-fq4qm" (UID: "96855631-beca-4d91-814d-689668f6de56") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:10:10.772881 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:10.772843    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret\") pod \"global-pull-secret-syncer-nrlb9\" (UID: \"42e12e95-3cc8-4393-93fb-087e19f92874\") " pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:10.773083 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:10.772976    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 01:10:10.773083 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:10.773060    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret podName:42e12e95-3cc8-4393-93fb-087e19f92874 nodeName:}" failed. No retries permitted until 2026-11-04 01:10:14.773039839 +0000 UTC m=+10.264588446 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret") pod "global-pull-secret-syncer-nrlb9" (UID: "42e12e95-3cc8-4393-93fb-087e19f92874") : object "kube-system"/"original-pull-secret" not registered
Nov 04 01:10:10.873700 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:10.873662    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56tjz\" (UniqueName: \"kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz\") pod \"network-check-target-zq545\" (UID: \"2db16eff-7518-4f50-b080-8208d5e756cc\") " pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:10.873885 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:10.873846    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 01:10:10.873885 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:10.873868    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 01:10:10.873885 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:10.873882    2571 projected.go:196] Error preparing data for projected volume kube-api-access-56tjz for pod openshift-network-diagnostics/network-check-target-zq545: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:10:10.874064 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:10.873940    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz podName:2db16eff-7518-4f50-b080-8208d5e756cc nodeName:}" failed. No retries permitted until 2026-11-04 01:10:14.873922775 +0000 UTC m=+10.365471382 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-56tjz" (UniqueName: "kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz") pod "network-check-target-zq545" (UID: "2db16eff-7518-4f50-b080-8208d5e756cc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:10:11.070256 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:11.069805    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:11.070256 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:11.069932    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zq545" podUID="2db16eff-7518-4f50-b080-8208d5e756cc"
Nov 04 01:10:11.070256 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:11.070021    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:11.070256 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:11.070116    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fq4qm" podUID="96855631-beca-4d91-814d-689668f6de56"
Nov 04 01:10:11.070256 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:11.070160    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:11.070256 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:11.070227    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nrlb9" podUID="42e12e95-3cc8-4393-93fb-087e19f92874"
Nov 04 01:10:11.125371 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:11.125338    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal" event={"ID":"a8e9fbe3308d7a9dc37557b42c180c40","Type":"ContainerStarted","Data":"7cd0a42b91e3448f112d64955349d3ea416b60e3800ed67fbdf0cdd70dbb2afd"}
Nov 04 01:10:13.074343 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:13.074277    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:13.074761 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:13.074405    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nrlb9" podUID="42e12e95-3cc8-4393-93fb-087e19f92874"
Nov 04 01:10:13.074761 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:13.074490    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:13.074761 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:13.074572    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zq545" podUID="2db16eff-7518-4f50-b080-8208d5e756cc"
Nov 04 01:10:13.074761 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:13.074636    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:13.074761 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:13.074720    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fq4qm" podUID="96855631-beca-4d91-814d-689668f6de56"
Nov 04 01:10:13.142546 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:13.142507    2571 generic.go:356] "Generic (PLEG): container finished" podID="f2aa811e393ce1519559d6514adffb05" containerID="ffc91ca8b0ce45dac2e1fa783cf1ae7999eb2a966f415961f751c876c51dbc56" exitCode=0
Nov 04 01:10:13.142848 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:13.142819    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal" event={"ID":"f2aa811e393ce1519559d6514adffb05","Type":"ContainerDied","Data":"ffc91ca8b0ce45dac2e1fa783cf1ae7999eb2a966f415961f751c876c51dbc56"}
Nov 04 01:10:13.146356 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:13.146328    2571 generic.go:356] "Generic (PLEG): container finished" podID="7af658ed-1cc4-4f7d-b9c8-c0437180bb43" containerID="5e93cabe44ed6b486f165cdf87587f7883880ffc96ec7c9211f6f7c27bea074d" exitCode=0
Nov 04 01:10:13.146462 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:13.146417    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25q95" event={"ID":"7af658ed-1cc4-4f7d-b9c8-c0437180bb43","Type":"ContainerDied","Data":"5e93cabe44ed6b486f165cdf87587f7883880ffc96ec7c9211f6f7c27bea074d"}
Nov 04 01:10:13.155152 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:13.155127    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vktnk" event={"ID":"39732b86-9f58-44ea-925e-a5e45c676586","Type":"ContainerStarted","Data":"be88d0e44823bc568c65e397db88d262ab144fbc3b13cd4f648a98c7906794b0"}
Nov 04 01:10:13.273769 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:13.273704    2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal" podStartSLOduration=6.273683761 podStartE2EDuration="6.273683761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:10:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:12.265152095 +0000 UTC m=+7.756700712" watchObservedRunningTime="2026-11-04 01:10:13.273683761 +0000 UTC m=+8.765232378"
Nov 04 01:10:13.541824 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:13.541332    2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vktnk" podStartSLOduration=2.2875478080000002 podStartE2EDuration="7.541310677s" totalImagesPullingTime="5.253762869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:13.403542776 +0000 UTC m=+8.895091390" watchObservedRunningTime="2026-11-04 01:10:13.541310677 +0000 UTC m=+9.032859294"
Nov 04 01:10:14.161573 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:14.161497    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n8xrm" event={"ID":"09213485-c715-420e-ab7d-c6cc3ee149a5","Type":"ContainerStarted","Data":"3bace1ed92dea7d710135c0d96bc3b6d1ee162970cdd5225472f2575092bafc1"}
Nov 04 01:10:14.166137 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:14.166063    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal" event={"ID":"f2aa811e393ce1519559d6514adffb05","Type":"ContainerStarted","Data":"1f107e96986ce7d1e8255b9dbbcbdd5231b3a2f2961d5d3f7c8107850faaf27f"}
Nov 04 01:10:14.293052 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:14.292988    2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n8xrm" podStartSLOduration=1.811422348 podStartE2EDuration="8.292966984s" totalImagesPullingTime="6.481544636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:14.292200999 +0000 UTC m=+9.783749616" watchObservedRunningTime="2026-11-04 01:10:14.292966984 +0000 UTC m=+9.784515598"
Nov 04 01:10:14.707738 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:14.707407    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs\") pod \"network-metrics-daemon-fq4qm\" (UID: \"96855631-beca-4d91-814d-689668f6de56\") " pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:14.707738 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:14.707631    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:10:14.707738 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:14.707700    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs podName:96855631-beca-4d91-814d-689668f6de56 nodeName:}" failed. No retries permitted until 2026-11-04 01:10:22.707680793 +0000 UTC m=+18.199229390 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs") pod "network-metrics-daemon-fq4qm" (UID: "96855631-beca-4d91-814d-689668f6de56") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:10:14.808570 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:14.808155    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret\") pod \"global-pull-secret-syncer-nrlb9\" (UID: \"42e12e95-3cc8-4393-93fb-087e19f92874\") " pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:14.808570 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:14.808379    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 01:10:14.808570 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:14.808442    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret podName:42e12e95-3cc8-4393-93fb-087e19f92874 nodeName:}" failed. No retries permitted until 2026-11-04 01:10:22.808425066 +0000 UTC m=+18.299973672 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret") pod "global-pull-secret-syncer-nrlb9" (UID: "42e12e95-3cc8-4393-93fb-087e19f92874") : object "kube-system"/"original-pull-secret" not registered
Nov 04 01:10:14.909400 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:14.909340    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56tjz\" (UniqueName: \"kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz\") pod \"network-check-target-zq545\" (UID: \"2db16eff-7518-4f50-b080-8208d5e756cc\") " pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:14.909604 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:14.909558    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 01:10:14.909604 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:14.909586    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 01:10:14.909604 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:14.909600    2571 projected.go:196] Error preparing data for projected volume kube-api-access-56tjz for pod openshift-network-diagnostics/network-check-target-zq545: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:10:14.909767 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:14.909653    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz podName:2db16eff-7518-4f50-b080-8208d5e756cc nodeName:}" failed. No retries permitted until 2026-11-04 01:10:22.90963986 +0000 UTC m=+18.401188464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-56tjz" (UniqueName: "kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz") pod "network-check-target-zq545" (UID: "2db16eff-7518-4f50-b080-8208d5e756cc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:10:15.071283 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:15.071198    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:15.071465 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:15.071333    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fq4qm" podUID="96855631-beca-4d91-814d-689668f6de56"
Nov 04 01:10:15.073160 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:15.073132    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:15.073287 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:15.073249    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zq545" podUID="2db16eff-7518-4f50-b080-8208d5e756cc"
Nov 04 01:10:15.073331 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:15.073318    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:15.073471 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:15.073408    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nrlb9" podUID="42e12e95-3cc8-4393-93fb-087e19f92874"
Nov 04 01:10:15.173016 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:15.172934    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft" event={"ID":"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2","Type":"ContainerStarted","Data":"71c289d4aeccfd41b21321e6b540ed3bebd443315838ff415a889ca313c408ac"}
Nov 04 01:10:16.268766 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:16.268182    2571 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vktnk"
Nov 04 01:10:16.269269 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:16.269091    2571 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vktnk"
Nov 04 01:10:16.401664 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:16.400687    2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal" podStartSLOduration=9.400667918 podStartE2EDuration="9.400667918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:10:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:14.42442516 +0000 UTC m=+9.915973773" watchObservedRunningTime="2026-11-04 01:10:16.400667918 +0000 UTC m=+11.892216534"
Nov 04 01:10:16.887740 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:16.887710    2571 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 04 01:10:16.993139 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:16.993032    2571 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T01:10:16.887734318Z","UUID":"ffd37aca-b89a-4010-8c49-8bd79d63d93a","Handler":null,"Name":"","Endpoint":""}
Nov 04 01:10:16.994523 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:16.994493    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 04 01:10:16.994523 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:16.994523    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 04 01:10:17.076640 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:17.076556    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:17.076804 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:17.076711    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:17.076804 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:17.076746    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:17.076804 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:17.076737    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zq545" podUID="2db16eff-7518-4f50-b080-8208d5e756cc"
Nov 04 01:10:17.076990 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:17.076857    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fq4qm" podUID="96855631-beca-4d91-814d-689668f6de56"
Nov 04 01:10:17.076990 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:17.076949    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nrlb9" podUID="42e12e95-3cc8-4393-93fb-087e19f92874"
Nov 04 01:10:17.179637 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:17.179595    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft" event={"ID":"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2","Type":"ContainerStarted","Data":"fdf0bbd919a488295c5ce4a75971828e0c03e8152e5ff54f8c1bc1ab94786135"}
Nov 04 01:10:17.182857 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:17.182823    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h9lvw" event={"ID":"4fc117ae-0111-4ce2-9676-f125a8b64be9","Type":"ContainerStarted","Data":"22fe515bec9eb6f285bd11b8f6924814280dff53121d2434e300dfd4053daba5"}
Nov 04 01:10:17.185279 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:17.185255    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dzffv" event={"ID":"c242f2eb-7d62-4990-84b0-04175eefc461","Type":"ContainerStarted","Data":"c39e44e5cb6cb2cf40474c7c75cd5edd2624e22d1c240161801ef3d9200a0622"}
Nov 04 01:10:17.427185 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:17.427135    2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-dzffv" podStartSLOduration=2.475978164 podStartE2EDuration="11.427121713s" totalImagesPullingTime="8.951143549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:17.426407959 +0000 UTC m=+12.917956571" watchObservedRunningTime="2026-11-04 01:10:17.427121713 +0000 UTC m=+12.918670321"
Nov 04 01:10:17.427628 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:17.427321    2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-h9lvw" podStartSLOduration=2.294852957 podStartE2EDuration="11.427307938s" totalImagesPullingTime="9.132454981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:17.306484768 +0000 UTC m=+12.798033380" watchObservedRunningTime="2026-11-04 01:10:17.427307938 +0000 UTC m=+12.918856553"
Nov 04 01:10:18.189872 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:18.189824    2571 generic.go:356] "Generic (PLEG): container finished" podID="7af658ed-1cc4-4f7d-b9c8-c0437180bb43" containerID="b8871c663d7b4837eb21892e173b1d7821bfdbd640dd2e0382ac5c9624248494" exitCode=0
Nov 04 01:10:18.191341 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:18.190847    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25q95" event={"ID":"7af658ed-1cc4-4f7d-b9c8-c0437180bb43","Type":"ContainerDied","Data":"b8871c663d7b4837eb21892e173b1d7821bfdbd640dd2e0382ac5c9624248494"}
Nov 04 01:10:19.069728 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:19.069696    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:19.070390 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:19.069696    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:19.070390 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:19.069820    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fq4qm" podUID="96855631-beca-4d91-814d-689668f6de56"
Nov 04 01:10:19.070390 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:19.069696    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:19.070390 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:19.069869    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nrlb9" podUID="42e12e95-3cc8-4393-93fb-087e19f92874"
Nov 04 01:10:19.070390 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:19.069935    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zq545" podUID="2db16eff-7518-4f50-b080-8208d5e756cc"
Nov 04 01:10:19.193380 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:19.193339    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7q5cg" event={"ID":"cf440cad-3487-46a5-9d2d-4badf508cbe1","Type":"ContainerStarted","Data":"cb373d927ba26a1d258c80fdc5cfd62e1249d893a87391db587518e1a26a64e3"}
Nov 04 01:10:19.195611 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:19.195578    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft" event={"ID":"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2","Type":"ContainerStarted","Data":"ce8a7b56af48a7f3912f721926fccdd662dfff2d6400ca79f0a8c6fae24b322e"}
Nov 04 01:10:19.197228 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:19.197197    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jz7tt" event={"ID":"9c5a2182-4c90-4ceb-b983-e7428f3a40be","Type":"ContainerStarted","Data":"60a76dc2d4b149c76516f75e796c21c8fcd4fdfe50777d1487b24af14e800e2f"}
Nov 04 01:10:19.316610 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:19.316512    2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7q5cg" podStartSLOduration=1.7111089069999998 podStartE2EDuration="13.31649003s" totalImagesPullingTime="11.605381123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:19.316349117 +0000 UTC m=+14.807897728" watchObservedRunningTime="2026-11-04 01:10:19.31649003 +0000 UTC m=+14.808038640"
Nov 04 01:10:19.437408 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:19.437353    2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jz7tt" podStartSLOduration=4.052993055 podStartE2EDuration="13.43733427s" totalImagesPullingTime="9.384341215s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:19.43653698 +0000 UTC m=+14.928085592" watchObservedRunningTime="2026-11-04 01:10:19.43733427 +0000 UTC m=+14.928882883"
Nov 04 01:10:19.560355 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:19.560305    2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft" podStartSLOduration=2.332750582 podStartE2EDuration="13.56029323s" totalImagesPullingTime="11.227542648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:10:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:19.559957354 +0000 UTC m=+15.051505964" watchObservedRunningTime="2026-11-04 01:10:19.56029323 +0000 UTC m=+15.051841840"
Nov 04 01:10:20.201885 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:20.201798    2571 generic.go:356] "Generic (PLEG): container finished" podID="7af658ed-1cc4-4f7d-b9c8-c0437180bb43" containerID="e9ed433d1d019f25726510aa0007cd3de8aac90981c0927278c18ebc3835cb62" exitCode=0
Nov 04 01:10:20.201885 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:20.201844    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25q95" event={"ID":"7af658ed-1cc4-4f7d-b9c8-c0437180bb43","Type":"ContainerDied","Data":"e9ed433d1d019f25726510aa0007cd3de8aac90981c0927278c18ebc3835cb62"}
Nov 04 01:10:21.070056 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:21.069813    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:21.070213 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:21.070177    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fq4qm" podUID="96855631-beca-4d91-814d-689668f6de56"
Nov 04 01:10:21.070213 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:21.069888    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:21.070295 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:21.070271    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nrlb9" podUID="42e12e95-3cc8-4393-93fb-087e19f92874"
Nov 04 01:10:21.070295 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:21.069838    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:21.070349 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:21.070337    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zq545" podUID="2db16eff-7518-4f50-b080-8208d5e756cc"
Nov 04 01:10:22.208546 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:22.208512    2571 generic.go:356] "Generic (PLEG): container finished" podID="7af658ed-1cc4-4f7d-b9c8-c0437180bb43" containerID="cba4caf1b8a322c8f5f137fa656dfd0a41dc7d13e17bc359e3e0cd5b78144eb5" exitCode=0
Nov 04 01:10:22.208950 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:22.208572    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25q95" event={"ID":"7af658ed-1cc4-4f7d-b9c8-c0437180bb43","Type":"ContainerDied","Data":"cba4caf1b8a322c8f5f137fa656dfd0a41dc7d13e17bc359e3e0cd5b78144eb5"}
Nov 04 01:10:22.776688 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:22.776645    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs\") pod \"network-metrics-daemon-fq4qm\" (UID: \"96855631-beca-4d91-814d-689668f6de56\") " pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:22.776881 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:22.776789    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:10:22.776881 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:22.776853    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs podName:96855631-beca-4d91-814d-689668f6de56 nodeName:}" failed. No retries permitted until 2026-11-04 01:10:38.776834867 +0000 UTC m=+34.268383468 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs") pod "network-metrics-daemon-fq4qm" (UID: "96855631-beca-4d91-814d-689668f6de56") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:10:22.877537 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:22.877495    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret\") pod \"global-pull-secret-syncer-nrlb9\" (UID: \"42e12e95-3cc8-4393-93fb-087e19f92874\") " pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:22.877712 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:22.877639    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 01:10:22.877773 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:22.877713    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret podName:42e12e95-3cc8-4393-93fb-087e19f92874 nodeName:}" failed. No retries permitted until 2026-11-04 01:10:38.877696285 +0000 UTC m=+34.369244879 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret") pod "global-pull-secret-syncer-nrlb9" (UID: "42e12e95-3cc8-4393-93fb-087e19f92874") : object "kube-system"/"original-pull-secret" not registered
Nov 04 01:10:22.978777 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:22.978736    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56tjz\" (UniqueName: \"kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz\") pod \"network-check-target-zq545\" (UID: \"2db16eff-7518-4f50-b080-8208d5e756cc\") " pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:22.979004 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:22.978945    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 01:10:22.979004 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:22.978979    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 01:10:22.979004 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:22.978991    2571 projected.go:196] Error preparing data for projected volume kube-api-access-56tjz for pod openshift-network-diagnostics/network-check-target-zq545: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:10:22.979184 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:22.979052    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz podName:2db16eff-7518-4f50-b080-8208d5e756cc nodeName:}" failed. No retries permitted until 2026-11-04 01:10:38.979033707 +0000 UTC m=+34.470582319 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-56tjz" (UniqueName: "kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz") pod "network-check-target-zq545" (UID: "2db16eff-7518-4f50-b080-8208d5e756cc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:10:23.071697 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:23.071622    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:23.071865 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:23.071741    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zq545" podUID="2db16eff-7518-4f50-b080-8208d5e756cc"
Nov 04 01:10:23.071865 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:23.071821    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:23.072003 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:23.071900    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fq4qm" podUID="96855631-beca-4d91-814d-689668f6de56"
Nov 04 01:10:23.072003 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:23.071957    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:23.072118 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:23.072051    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nrlb9" podUID="42e12e95-3cc8-4393-93fb-087e19f92874"
Nov 04 01:10:23.844411 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:23.844384    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dzffv_c242f2eb-7d62-4990-84b0-04175eefc461/dns-node-resolver/0.log"
Nov 04 01:10:24.866768 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:24.866695    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n8xrm_09213485-c715-420e-ab7d-c6cc3ee149a5/node-ca/0.log"
Nov 04 01:10:25.070852 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:25.070818    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:25.071019 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:25.070927    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:25.071019 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:25.070945    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nrlb9" podUID="42e12e95-3cc8-4393-93fb-087e19f92874"
Nov 04 01:10:25.071094 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:25.071034    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zq545" podUID="2db16eff-7518-4f50-b080-8208d5e756cc"
Nov 04 01:10:25.071094 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:25.071077    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:25.071153 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:25.071134    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fq4qm" podUID="96855631-beca-4d91-814d-689668f6de56"
Nov 04 01:10:25.218668 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:25.218589    2571 generic.go:356] "Generic (PLEG): container finished" podID="7af658ed-1cc4-4f7d-b9c8-c0437180bb43" containerID="443e4ee7f7fc3325edc83ea871dbabb78c636b01286376a47c04d822596f4fcc" exitCode=0
Nov 04 01:10:25.218668 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:25.218643    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25q95" event={"ID":"7af658ed-1cc4-4f7d-b9c8-c0437180bb43","Type":"ContainerDied","Data":"443e4ee7f7fc3325edc83ea871dbabb78c636b01286376a47c04d822596f4fcc"}
Nov 04 01:10:26.223675 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:26.223426    2571 generic.go:356] "Generic (PLEG): container finished" podID="7af658ed-1cc4-4f7d-b9c8-c0437180bb43" containerID="2d19635722f0d9741ab846b42c32c502aa4fbd4435ede20599a5409ecb563f4b" exitCode=0
Nov 04 01:10:26.224065 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:26.223497    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25q95" event={"ID":"7af658ed-1cc4-4f7d-b9c8-c0437180bb43","Type":"ContainerDied","Data":"2d19635722f0d9741ab846b42c32c502aa4fbd4435ede20599a5409ecb563f4b"}
Nov 04 01:10:26.225823 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:26.225802    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4glcp" event={"ID":"51c03abc-b77b-4b72-a707-293e13734fae","Type":"ContainerStarted","Data":"7c675746efca8b66699bb8bffcbabc9746e5549fc9c191da246ec9b0b6af62b8"}
Nov 04 01:10:26.225893 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:26.225877    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4glcp" event={"ID":"51c03abc-b77b-4b72-a707-293e13734fae","Type":"ContainerStarted","Data":"180d45dbb90260eae154c066bce2e786a8fc6f4062e4e07f74e16a3a9b112db1"}
Nov 04 01:10:26.225947 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:26.225931    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4glcp" event={"ID":"51c03abc-b77b-4b72-a707-293e13734fae","Type":"ContainerStarted","Data":"07c11e17f3bcc614e0e1e5362c507da0ae02dea06d8e0e3c289bb0c3d8eca843"}
Nov 04 01:10:27.069941 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:27.069908    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:27.069941 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:27.069936    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:27.070160 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:27.070069    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fq4qm" podUID="96855631-beca-4d91-814d-689668f6de56"
Nov 04 01:10:27.070160 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:27.070105    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:27.070160 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:27.070153    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nrlb9" podUID="42e12e95-3cc8-4393-93fb-087e19f92874"
Nov 04 01:10:27.070277 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:27.070199    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zq545" podUID="2db16eff-7518-4f50-b080-8208d5e756cc"
Nov 04 01:10:27.231335 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:27.231302    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25q95" event={"ID":"7af658ed-1cc4-4f7d-b9c8-c0437180bb43","Type":"ContainerStarted","Data":"a4fa8a7e231f128de98de451d7311050a656f29fec0a2fc313a1210a9ceecfb5"}
Nov 04 01:10:27.234237 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:27.234214    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4glcp" event={"ID":"51c03abc-b77b-4b72-a707-293e13734fae","Type":"ContainerStarted","Data":"de1363ffd24aa02a38e7e312fe63a98f6f7d92f97e0df5e047da18a2ab771de9"}
Nov 04 01:10:27.234350 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:27.234270    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4glcp" event={"ID":"51c03abc-b77b-4b72-a707-293e13734fae","Type":"ContainerStarted","Data":"9d3883a9c730ac8eba6a4632db6e7355e10ed29227e1ea8275c613ceade3ee18"}
Nov 04 01:10:27.234350 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:27.234300    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4glcp" event={"ID":"51c03abc-b77b-4b72-a707-293e13734fae","Type":"ContainerStarted","Data":"97a43a822859d7c2aeb62c14a679e73deaf7e2bf272b7350294b277d48a56bfa"}
Nov 04 01:10:27.359330 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:27.359240    2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-25q95" podStartSLOduration=7.975976244 podStartE2EDuration="21.359227533s" totalImagesPullingTime="13.383251289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:10:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:27.358662485 +0000 UTC m=+22.850211096" watchObservedRunningTime="2026-11-04 01:10:27.359227533 +0000 UTC m=+22.850776144"
Nov 04 01:10:29.069957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:29.069924    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:29.069957 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:29.069944    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:29.070575 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:29.069925    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:29.070575 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:29.070086    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nrlb9" podUID="42e12e95-3cc8-4393-93fb-087e19f92874"
Nov 04 01:10:29.070575 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:29.070154    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zq545" podUID="2db16eff-7518-4f50-b080-8208d5e756cc"
Nov 04 01:10:29.070575 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:29.070201    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fq4qm" podUID="96855631-beca-4d91-814d-689668f6de56"
Nov 04 01:10:29.241035 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:29.241005    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4glcp" event={"ID":"51c03abc-b77b-4b72-a707-293e13734fae","Type":"ContainerStarted","Data":"017fbf03322d6daf2c1cdaaa014b2882ed06112caba6ddbf5f9c2873e614b27c"}
Nov 04 01:10:31.070395 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:31.070367    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:31.070988 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:31.070398    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:31.070988 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:31.070365    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:31.070988 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:31.070479    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zq545" podUID="2db16eff-7518-4f50-b080-8208d5e756cc"
Nov 04 01:10:31.070988 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:31.070542    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nrlb9" podUID="42e12e95-3cc8-4393-93fb-087e19f92874"
Nov 04 01:10:31.070988 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:31.070654    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fq4qm" podUID="96855631-beca-4d91-814d-689668f6de56"
Nov 04 01:10:31.248457 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:31.248429    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4glcp" event={"ID":"51c03abc-b77b-4b72-a707-293e13734fae","Type":"ContainerStarted","Data":"faf33a78abfcdec3e208019062597fd68f1e43f76c04c0a8a6330f0518d78740"}
Nov 04 01:10:31.248665 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:31.248647    2571 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:31.248761 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:31.248717    2571 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:31.263420 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:31.263399    2571 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:31.542160 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:31.541927    2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4glcp" podStartSLOduration=6.886093971 podStartE2EDuration="25.541916646s" totalImagesPullingTime="18.655822675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:31.4889313 +0000 UTC m=+26.980479910" watchObservedRunningTime="2026-11-04 01:10:31.541916646 +0000 UTC m=+27.033465256"
Nov 04 01:10:32.251279 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:32.251250    2571 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:32.266339 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:32.266314    2571 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:10:33.070393 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:33.070359    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:33.070393 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:33.070379    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:33.070590 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:33.070363    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:33.070590 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:33.070477    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nrlb9" podUID="42e12e95-3cc8-4393-93fb-087e19f92874"
Nov 04 01:10:33.070590 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:33.070544    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fq4qm" podUID="96855631-beca-4d91-814d-689668f6de56"
Nov 04 01:10:33.070680 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:33.070608    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zq545" podUID="2db16eff-7518-4f50-b080-8208d5e756cc"
Nov 04 01:10:34.513615 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:34.513576    2571 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vktnk"
Nov 04 01:10:34.514024 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:34.513748    2571 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 01:10:34.514182 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:34.514168    2571 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vktnk"
Nov 04 01:10:35.070426 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:35.070396    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:35.070599 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:35.070472    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fq4qm" podUID="96855631-beca-4d91-814d-689668f6de56"
Nov 04 01:10:35.070599 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:35.070576    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:35.070711 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:35.070689    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nrlb9" podUID="42e12e95-3cc8-4393-93fb-087e19f92874"
Nov 04 01:10:35.070749 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:35.070699    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:35.070796 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:35.070758    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zq545" podUID="2db16eff-7518-4f50-b080-8208d5e756cc"
Nov 04 01:10:37.069873 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:37.069843    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:37.070245 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:37.069873    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:37.070245 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:37.069937    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zq545" podUID="2db16eff-7518-4f50-b080-8208d5e756cc"
Nov 04 01:10:37.070245 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:37.069995    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:37.070245 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:37.070127    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fq4qm" podUID="96855631-beca-4d91-814d-689668f6de56"
Nov 04 01:10:37.070245 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:37.070211    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nrlb9" podUID="42e12e95-3cc8-4393-93fb-087e19f92874"
Nov 04 01:10:38.798963 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:38.798932    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs\") pod \"network-metrics-daemon-fq4qm\" (UID: \"96855631-beca-4d91-814d-689668f6de56\") " pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:38.799334 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:38.799081    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:10:38.799334 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:38.799135    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs podName:96855631-beca-4d91-814d-689668f6de56 nodeName:}" failed. No retries permitted until 2026-11-04 01:11:10.799121652 +0000 UTC m=+66.290670241 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs") pod "network-metrics-daemon-fq4qm" (UID: "96855631-beca-4d91-814d-689668f6de56") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:10:38.899598 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:38.899571    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret\") pod \"global-pull-secret-syncer-nrlb9\" (UID: \"42e12e95-3cc8-4393-93fb-087e19f92874\") " pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:38.899713 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:38.899683    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 01:10:38.899750 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:38.899730    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret podName:42e12e95-3cc8-4393-93fb-087e19f92874 nodeName:}" failed. No retries permitted until 2026-11-04 01:11:10.899714654 +0000 UTC m=+66.391263246 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret") pod "global-pull-secret-syncer-nrlb9" (UID: "42e12e95-3cc8-4393-93fb-087e19f92874") : object "kube-system"/"original-pull-secret" not registered
Nov 04 01:10:39.000766 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:39.000741    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56tjz\" (UniqueName: \"kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz\") pod \"network-check-target-zq545\" (UID: \"2db16eff-7518-4f50-b080-8208d5e756cc\") " pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:39.000876 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:39.000845    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 01:10:39.000876 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:39.000859    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 01:10:39.000876 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:39.000867    2571 projected.go:196] Error preparing data for projected volume kube-api-access-56tjz for pod openshift-network-diagnostics/network-check-target-zq545: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:10:39.000983 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:39.000905    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz podName:2db16eff-7518-4f50-b080-8208d5e756cc nodeName:}" failed. No retries permitted until 2026-11-04 01:11:11.000893459 +0000 UTC m=+66.492442071 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-56tjz" (UniqueName: "kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz") pod "network-check-target-zq545" (UID: "2db16eff-7518-4f50-b080-8208d5e756cc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:10:39.069411 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:39.069354    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:39.069411 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:39.069367    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:39.069411 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:39.069354    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:39.069610 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:39.069471    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zq545" podUID="2db16eff-7518-4f50-b080-8208d5e756cc"
Nov 04 01:10:39.069610 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:39.069505    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nrlb9" podUID="42e12e95-3cc8-4393-93fb-087e19f92874"
Nov 04 01:10:39.069610 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:39.069568    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fq4qm" podUID="96855631-beca-4d91-814d-689668f6de56"
Nov 04 01:10:41.070436 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:41.070402    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:41.070997 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:41.070408    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:41.070997 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:41.070517    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nrlb9" podUID="42e12e95-3cc8-4393-93fb-087e19f92874"
Nov 04 01:10:41.070997 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:41.070538    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:41.070997 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:41.070613    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fq4qm" podUID="96855631-beca-4d91-814d-689668f6de56"
Nov 04 01:10:41.070997 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:41.070668    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zq545" podUID="2db16eff-7518-4f50-b080-8208d5e756cc"
Nov 04 01:10:42.296914 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:42.296883    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zq545"]
Nov 04 01:10:42.297268 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:42.297020    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:42.297268 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:42.297183    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zq545" podUID="2db16eff-7518-4f50-b080-8208d5e756cc"
Nov 04 01:10:42.299618 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:42.299596    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nrlb9"]
Nov 04 01:10:42.299732 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:42.299685    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:42.299789 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:42.299769    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nrlb9" podUID="42e12e95-3cc8-4393-93fb-087e19f92874"
Nov 04 01:10:42.300248 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:42.300228    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fq4qm"]
Nov 04 01:10:42.300337 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:42.300319    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:42.300433 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:42.300415    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fq4qm" podUID="96855631-beca-4d91-814d-689668f6de56"
Nov 04 01:10:44.070049 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:44.070021    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:44.070049 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:44.070042    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:44.070424 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:44.070021    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:44.070424 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:44.070125    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fq4qm" podUID="96855631-beca-4d91-814d-689668f6de56"
Nov 04 01:10:44.070424 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:44.070193    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nrlb9" podUID="42e12e95-3cc8-4393-93fb-087e19f92874"
Nov 04 01:10:44.070424 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:44.070244    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zq545" podUID="2db16eff-7518-4f50-b080-8208d5e756cc"
Nov 04 01:10:46.070287 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:46.070261    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:46.070648 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:46.070256    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:46.070648 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:46.070349    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nrlb9" podUID="42e12e95-3cc8-4393-93fb-087e19f92874"
Nov 04 01:10:46.070648 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:46.070266    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:46.070648 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:46.070428    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fq4qm" podUID="96855631-beca-4d91-814d-689668f6de56"
Nov 04 01:10:46.070648 ip-10-0-131-51 kubenswrapper[2571]: E1104 01:10:46.070502    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zq545" podUID="2db16eff-7518-4f50-b080-8208d5e756cc"
Nov 04 01:10:47.332808 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.332641    2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeReady"
Nov 04 01:10:47.333177 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.332888    2571 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Nov 04 01:10:47.497908 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.497846    2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xlwwn"]
Nov 04 01:10:47.538858 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.538837    2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-25blp"]
Nov 04 01:10:47.538988 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.538953    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:10:47.552818 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.552800    2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mmvnr"]
Nov 04 01:10:47.552943 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.552913    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-25blp"
Nov 04 01:10:47.562181 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.562164    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea-config-volume\") pod \"dns-default-xlwwn\" (UID: \"4a5b0ed1-dd30-4117-9cd0-e8140080e8ea\") " pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:10:47.562260 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.562185    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea-tmp-dir\") pod \"dns-default-xlwwn\" (UID: \"4a5b0ed1-dd30-4117-9cd0-e8140080e8ea\") " pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:10:47.562260 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.562210    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea-metrics-tls\") pod \"dns-default-xlwwn\" (UID: \"4a5b0ed1-dd30-4117-9cd0-e8140080e8ea\") " pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:10:47.562260 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.562224    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxgrv\" (UniqueName: \"kubernetes.io/projected/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea-kube-api-access-hxgrv\") pod \"dns-default-xlwwn\" (UID: \"4a5b0ed1-dd30-4117-9cd0-e8140080e8ea\") " pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:10:47.562376 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.562362    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26e3ee34-ace5-4eda-a96a-6c0014a989ee-cert\") pod \"ingress-canary-25blp\" (UID: \"26e3ee34-ace5-4eda-a96a-6c0014a989ee\") " pod="openshift-ingress-canary/ingress-canary-25blp"
Nov 04 01:10:47.562408 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.562385    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bm95\" (UniqueName: \"kubernetes.io/projected/26e3ee34-ace5-4eda-a96a-6c0014a989ee-kube-api-access-8bm95\") pod \"ingress-canary-25blp\" (UID: \"26e3ee34-ace5-4eda-a96a-6c0014a989ee\") " pod="openshift-ingress-canary/ingress-canary-25blp"
Nov 04 01:10:47.566754 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.566737    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xlwwn"]
Nov 04 01:10:47.566836 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.566782    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-25blp"]
Nov 04 01:10:47.566836 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.566806    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mmvnr"]
Nov 04 01:10:47.566918 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.566840    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:10:47.594470 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.594452    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 04 01:10:47.595076 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.595061    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 04 01:10:47.595116 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.595085    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ldpj7\""
Nov 04 01:10:47.608322 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.608303    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 04 01:10:47.617462 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.617446    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 04 01:10:47.617516 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.617483    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 04 01:10:47.617516 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.617507    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-9dncz\""
Nov 04 01:10:47.663132 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.663110    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/39954ddf-ace6-4e62-a9b4-5d12a77b202c-data-volume\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:10:47.663223 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.663138    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39954ddf-ace6-4e62-a9b4-5d12a77b202c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:10:47.663223 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.663180    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lp9w\" (UniqueName: \"kubernetes.io/projected/39954ddf-ace6-4e62-a9b4-5d12a77b202c-kube-api-access-5lp9w\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:10:47.663292 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.663248    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/39954ddf-ace6-4e62-a9b4-5d12a77b202c-crio-socket\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:10:47.663292 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.663282    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea-config-volume\") pod \"dns-default-xlwwn\" (UID: \"4a5b0ed1-dd30-4117-9cd0-e8140080e8ea\") " pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:10:47.663356 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.663297    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea-tmp-dir\") pod \"dns-default-xlwwn\" (UID: \"4a5b0ed1-dd30-4117-9cd0-e8140080e8ea\") " pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:10:47.663356 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.663322    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39954ddf-ace6-4e62-a9b4-5d12a77b202c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:10:47.663431 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.663396    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea-metrics-tls\") pod \"dns-default-xlwwn\" (UID: \"4a5b0ed1-dd30-4117-9cd0-e8140080e8ea\") " pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:10:47.663480 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.663427    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxgrv\" (UniqueName: \"kubernetes.io/projected/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea-kube-api-access-hxgrv\") pod \"dns-default-xlwwn\" (UID: \"4a5b0ed1-dd30-4117-9cd0-e8140080e8ea\") " pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:10:47.663480 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.663473    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26e3ee34-ace5-4eda-a96a-6c0014a989ee-cert\") pod \"ingress-canary-25blp\" (UID: \"26e3ee34-ace5-4eda-a96a-6c0014a989ee\") " pod="openshift-ingress-canary/ingress-canary-25blp"
Nov 04 01:10:47.663572 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.663499    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bm95\" (UniqueName: \"kubernetes.io/projected/26e3ee34-ace5-4eda-a96a-6c0014a989ee-kube-api-access-8bm95\") pod \"ingress-canary-25blp\" (UID: \"26e3ee34-ace5-4eda-a96a-6c0014a989ee\") " pod="openshift-ingress-canary/ingress-canary-25blp"
Nov 04 01:10:47.663625 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.663608    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea-tmp-dir\") pod \"dns-default-xlwwn\" (UID: \"4a5b0ed1-dd30-4117-9cd0-e8140080e8ea\") " pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:10:47.663880 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.663860    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea-config-volume\") pod \"dns-default-xlwwn\" (UID: \"4a5b0ed1-dd30-4117-9cd0-e8140080e8ea\") " pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:10:47.667072 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.667052    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea-metrics-tls\") pod \"dns-default-xlwwn\" (UID: \"4a5b0ed1-dd30-4117-9cd0-e8140080e8ea\") " pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:10:47.667072 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.667069    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26e3ee34-ace5-4eda-a96a-6c0014a989ee-cert\") pod \"ingress-canary-25blp\" (UID: \"26e3ee34-ace5-4eda-a96a-6c0014a989ee\") " pod="openshift-ingress-canary/ingress-canary-25blp"
Nov 04 01:10:47.695060 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.695040    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 04 01:10:47.695147 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.695097    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 04 01:10:47.695147 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.695106    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 04 01:10:47.695238 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.695218    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 04 01:10:47.695284 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.695244    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qr45v\""
Nov 04 01:10:47.726612 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.726593    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bm95\" (UniqueName: \"kubernetes.io/projected/26e3ee34-ace5-4eda-a96a-6c0014a989ee-kube-api-access-8bm95\") pod \"ingress-canary-25blp\" (UID: \"26e3ee34-ace5-4eda-a96a-6c0014a989ee\") " pod="openshift-ingress-canary/ingress-canary-25blp"
Nov 04 01:10:47.726700 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.726634    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxgrv\" (UniqueName: \"kubernetes.io/projected/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea-kube-api-access-hxgrv\") pod \"dns-default-xlwwn\" (UID: \"4a5b0ed1-dd30-4117-9cd0-e8140080e8ea\") " pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:10:47.764144 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.764102    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lp9w\" (UniqueName: \"kubernetes.io/projected/39954ddf-ace6-4e62-a9b4-5d12a77b202c-kube-api-access-5lp9w\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:10:47.764144 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.764127    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/39954ddf-ace6-4e62-a9b4-5d12a77b202c-crio-socket\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:10:47.764272 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.764158    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39954ddf-ace6-4e62-a9b4-5d12a77b202c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:10:47.764272 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.764191    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/39954ddf-ace6-4e62-a9b4-5d12a77b202c-data-volume\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:10:47.764272 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.764207    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39954ddf-ace6-4e62-a9b4-5d12a77b202c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:10:47.764405 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.764334    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/39954ddf-ace6-4e62-a9b4-5d12a77b202c-crio-socket\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:10:47.764485 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.764470    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/39954ddf-ace6-4e62-a9b4-5d12a77b202c-data-volume\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:10:47.764620 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.764604    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39954ddf-ace6-4e62-a9b4-5d12a77b202c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:10:47.766023 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.766008    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39954ddf-ace6-4e62-a9b4-5d12a77b202c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:10:47.827221 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.827200    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lp9w\" (UniqueName: \"kubernetes.io/projected/39954ddf-ace6-4e62-a9b4-5d12a77b202c-kube-api-access-5lp9w\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:10:47.873342 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.873323    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:10:47.891449 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.891429    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-25blp"
Nov 04 01:10:47.931124 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:47.931104    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:10:48.069772 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:48.069749    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:10:48.069900 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:48.069776    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:10:48.069900 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:48.069783    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:10:48.125684 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:48.125665    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 04 01:10:48.125855 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:48.125839    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 04 01:10:48.125913 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:48.125856    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8lz6w\""
Nov 04 01:10:48.126096 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:48.126083    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-x4nsn\""
Nov 04 01:10:48.126153 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:48.126117    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 04 01:10:48.126202 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:48.126189    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-8hhs6\""
Nov 04 01:10:48.126254 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:48.126208    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 04 01:10:48.372804 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:48.372775    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-25blp"]
Nov 04 01:10:48.377950 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:48.377931    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xlwwn"]
Nov 04 01:10:48.378529 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:48.378512    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mmvnr"]
Nov 04 01:10:49.287312 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:49.287278    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mmvnr" event={"ID":"39954ddf-ace6-4e62-a9b4-5d12a77b202c","Type":"ContainerStarted","Data":"9cbf0c66d1cd6b45d8467b957d344f4cbc56b31cdff01731ba42be5b61ea8f86"}
Nov 04 01:10:49.287461 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:49.287337    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mmvnr" event={"ID":"39954ddf-ace6-4e62-a9b4-5d12a77b202c","Type":"ContainerStarted","Data":"7687c626b27a4f2a5ac248780f34f95a551c2a479d8636a2e0452d365276a21f"}
Nov 04 01:10:49.290309 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:49.290273    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-25blp" event={"ID":"26e3ee34-ace5-4eda-a96a-6c0014a989ee","Type":"ContainerStarted","Data":"7164a2072ebbc5206a8613c13bc1bbc7230f1843ebbceff03f1d177e776a66c2"}
Nov 04 01:10:49.291685 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:49.291652    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xlwwn" event={"ID":"4a5b0ed1-dd30-4117-9cd0-e8140080e8ea","Type":"ContainerStarted","Data":"d5b71c5c77a5dbada7375109bd6643a3c6252aa57d74481478287246e3dd79c9"}
Nov 04 01:10:51.299019 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:51.298987    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mmvnr" event={"ID":"39954ddf-ace6-4e62-a9b4-5d12a77b202c","Type":"ContainerStarted","Data":"a4c8512c6b2b13b0e3b79bb5b47439f6878303a150db9d1e825fcc5aa9b3681e"}
Nov 04 01:10:51.300514 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:51.300484    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xlwwn" event={"ID":"4a5b0ed1-dd30-4117-9cd0-e8140080e8ea","Type":"ContainerStarted","Data":"3f2db9fdb9476f8d3c301417c3a64057e12494d30b78442ed7d8f96806707774"}
Nov 04 01:10:52.180683 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.180386    2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"]
Nov 04 01:10:52.183342 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.183318    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"
Nov 04 01:10:52.197485 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.197457    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/081d2b6e-a762-4015-8a75-a43b0f6c9e66-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-mqzrv\" (UID: \"081d2b6e-a762-4015-8a75-a43b0f6c9e66\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"
Nov 04 01:10:52.197606 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.197497    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/081d2b6e-a762-4015-8a75-a43b0f6c9e66-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-mqzrv\" (UID: \"081d2b6e-a762-4015-8a75-a43b0f6c9e66\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"
Nov 04 01:10:52.197606 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.197545    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r69h\" (UniqueName: \"kubernetes.io/projected/081d2b6e-a762-4015-8a75-a43b0f6c9e66-kube-api-access-5r69h\") pod \"openshift-state-metrics-7bd7489957-mqzrv\" (UID: \"081d2b6e-a762-4015-8a75-a43b0f6c9e66\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"
Nov 04 01:10:52.197606 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.197575    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/081d2b6e-a762-4015-8a75-a43b0f6c9e66-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-mqzrv\" (UID: \"081d2b6e-a762-4015-8a75-a43b0f6c9e66\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"
Nov 04 01:10:52.238484 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.238382    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"]
Nov 04 01:10:52.290772 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.290680    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Nov 04 01:10:52.290772 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.290719    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 04 01:10:52.290772 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.290724    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 04 01:10:52.294238 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.294219    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-rqkm5\""
Nov 04 01:10:52.294365 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.294274    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Nov 04 01:10:52.294365 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.294298    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 04 01:10:52.298683 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.298660    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/081d2b6e-a762-4015-8a75-a43b0f6c9e66-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-mqzrv\" (UID: \"081d2b6e-a762-4015-8a75-a43b0f6c9e66\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"
Nov 04 01:10:52.298824 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.298700    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/081d2b6e-a762-4015-8a75-a43b0f6c9e66-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-mqzrv\" (UID: \"081d2b6e-a762-4015-8a75-a43b0f6c9e66\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"
Nov 04 01:10:52.298824 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.298752    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r69h\" (UniqueName: \"kubernetes.io/projected/081d2b6e-a762-4015-8a75-a43b0f6c9e66-kube-api-access-5r69h\") pod \"openshift-state-metrics-7bd7489957-mqzrv\" (UID: \"081d2b6e-a762-4015-8a75-a43b0f6c9e66\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"
Nov 04 01:10:52.299013 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.298995    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/081d2b6e-a762-4015-8a75-a43b0f6c9e66-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-mqzrv\" (UID: \"081d2b6e-a762-4015-8a75-a43b0f6c9e66\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"
Nov 04 01:10:52.299606 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.299586    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/081d2b6e-a762-4015-8a75-a43b0f6c9e66-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-mqzrv\" (UID: \"081d2b6e-a762-4015-8a75-a43b0f6c9e66\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"
Nov 04 01:10:52.302595 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.302573    2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lc7jc"]
Nov 04 01:10:52.303348 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.303330    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/081d2b6e-a762-4015-8a75-a43b0f6c9e66-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-mqzrv\" (UID: \"081d2b6e-a762-4015-8a75-a43b0f6c9e66\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"
Nov 04 01:10:52.303438 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.303391    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/081d2b6e-a762-4015-8a75-a43b0f6c9e66-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-mqzrv\" (UID: \"081d2b6e-a762-4015-8a75-a43b0f6c9e66\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"
Nov 04 01:10:52.315204 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.315184    2571 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:10:52.315283 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.315214    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-25blp" event={"ID":"26e3ee34-ace5-4eda-a96a-6c0014a989ee","Type":"ContainerStarted","Data":"c704bb73296f52cb3795bbcb2ccb24ee36c5d9195187072879172514bb477633"}
Nov 04 01:10:52.315283 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.315232    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xlwwn" event={"ID":"4a5b0ed1-dd30-4117-9cd0-e8140080e8ea","Type":"ContainerStarted","Data":"1c3263dd85eb48d730f84f0b99d4e35469c4aa232afc5b1490297d23a87e46e0"}
Nov 04 01:10:52.315352 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.315291    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.344502 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.344480    2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"]
Nov 04 01:10:52.346725 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.346712    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:10:52.362415 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.362392    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r69h\" (UniqueName: \"kubernetes.io/projected/081d2b6e-a762-4015-8a75-a43b0f6c9e66-kube-api-access-5r69h\") pod \"openshift-state-metrics-7bd7489957-mqzrv\" (UID: \"081d2b6e-a762-4015-8a75-a43b0f6c9e66\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"
Nov 04 01:10:52.375329 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.375311    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 04 01:10:52.396011 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.395990    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"]
Nov 04 01:10:52.400193 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.400170    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-wtmp\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.400284 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.400199    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-textfile\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.400284 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.400227    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db2a554a-660a-4b82-8e0e-70eaac7d1136-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:10:52.400400 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.400300    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/db2a554a-660a-4b82-8e0e-70eaac7d1136-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:10:52.400400 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.400361    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f23f719-7430-4b54-9204-13d0c5bebf96-sys\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.400400 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.400386    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/db2a554a-660a-4b82-8e0e-70eaac7d1136-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:10:52.400591 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.400406    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f23f719-7430-4b54-9204-13d0c5bebf96-metrics-client-ca\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.400591 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.400494    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckw42\" (UniqueName: \"kubernetes.io/projected/1f23f719-7430-4b54-9204-13d0c5bebf96-kube-api-access-ckw42\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.400591 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.400523    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4kv5\" (UniqueName: \"kubernetes.io/projected/db2a554a-660a-4b82-8e0e-70eaac7d1136-kube-api-access-j4kv5\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:10:52.400591 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.400551    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db2a554a-660a-4b82-8e0e-70eaac7d1136-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:10:52.400591 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.400579    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-accelerators-collector-config\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.400808 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.400601    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.400808 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.400660    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-tls\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.400808 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.400689    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/db2a554a-660a-4b82-8e0e-70eaac7d1136-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:10:52.400808 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.400719    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f23f719-7430-4b54-9204-13d0c5bebf96-root\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.449871 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.449813    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 04 01:10:52.450000 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.449987    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 04 01:10:52.450071 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.450030    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Nov 04 01:10:52.450071 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.450059    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Nov 04 01:10:52.450071 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.450063    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zgtmx\""
Nov 04 01:10:52.450186 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.450080    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gg5mw\""
Nov 04 01:10:52.450186 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.450107    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Nov 04 01:10:52.470852 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.470809    2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-xlwwn" podStartSLOduration=2.737692867 podStartE2EDuration="5.470799143s" totalImagesPullingTime="2.733106276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:10:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:52.470408135 +0000 UTC m=+47.961956744" watchObservedRunningTime="2026-11-04 01:10:52.470799143 +0000 UTC m=+47.962347752"
Nov 04 01:10:52.498094 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.498070    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"
Nov 04 01:10:52.501317 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.501296    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/db2a554a-660a-4b82-8e0e-70eaac7d1136-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:10:52.501414 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.501322    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f23f719-7430-4b54-9204-13d0c5bebf96-sys\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.501414 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.501338    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/db2a554a-660a-4b82-8e0e-70eaac7d1136-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:10:52.501414 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.501353    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f23f719-7430-4b54-9204-13d0c5bebf96-metrics-client-ca\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.501414 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.501391    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckw42\" (UniqueName: \"kubernetes.io/projected/1f23f719-7430-4b54-9204-13d0c5bebf96-kube-api-access-ckw42\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.501608 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.501414    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f23f719-7430-4b54-9204-13d0c5bebf96-sys\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.501608 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.501417    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4kv5\" (UniqueName: \"kubernetes.io/projected/db2a554a-660a-4b82-8e0e-70eaac7d1136-kube-api-access-j4kv5\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:10:52.501608 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.501461    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db2a554a-660a-4b82-8e0e-70eaac7d1136-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:10:52.501744 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.501667    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-accelerators-collector-config\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.501744 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.501698    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.501744 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.501737    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-tls\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.501883 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.501758    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/db2a554a-660a-4b82-8e0e-70eaac7d1136-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:10:52.501883 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.501776    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/db2a554a-660a-4b82-8e0e-70eaac7d1136-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:10:52.501883 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.501783    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f23f719-7430-4b54-9204-13d0c5bebf96-root\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.501883 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.501827    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f23f719-7430-4b54-9204-13d0c5bebf96-root\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.501883 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.501865    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-wtmp\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.502139 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.501892    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-textfile\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.502139 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.501938    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db2a554a-660a-4b82-8e0e-70eaac7d1136-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:10:52.502139 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.502096    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f23f719-7430-4b54-9204-13d0c5bebf96-metrics-client-ca\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.502139 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.502124    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/db2a554a-660a-4b82-8e0e-70eaac7d1136-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:10:52.502329 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.502211    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-wtmp\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.502329 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.502277    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-accelerators-collector-config\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.502429 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.502401    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-textfile\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.502631 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.502608    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db2a554a-660a-4b82-8e0e-70eaac7d1136-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:10:52.504172 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.504132    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db2a554a-660a-4b82-8e0e-70eaac7d1136-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:10:52.504434 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.504416    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-tls\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.504504 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.504477    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/db2a554a-660a-4b82-8e0e-70eaac7d1136-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:10:52.504601 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.504582    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.571842 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.571713    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckw42\" (UniqueName: \"kubernetes.io/projected/1f23f719-7430-4b54-9204-13d0c5bebf96-kube-api-access-ckw42\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.571954 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.571806    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4kv5\" (UniqueName: \"kubernetes.io/projected/db2a554a-660a-4b82-8e0e-70eaac7d1136-kube-api-access-j4kv5\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:10:52.628235 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.628207    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:10:52.639162 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:52.639137    2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f23f719_7430_4b54_9204_13d0c5bebf96.slice/crio-595f7603f5f2fe03f14228d78dc5a53c997b3d6b190092a9e5c8c725e0cf375e WatchSource:0}: Error finding container 595f7603f5f2fe03f14228d78dc5a53c997b3d6b190092a9e5c8c725e0cf375e: Status 404 returned error can't find the container with id 595f7603f5f2fe03f14228d78dc5a53c997b3d6b190092a9e5c8c725e0cf375e
Nov 04 01:10:52.659696 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.659676    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:10:52.714016 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.713937    2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-25blp" podStartSLOduration=2.095250898 podStartE2EDuration="5.713917675s" totalImagesPullingTime="3.618666777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:10:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:52.71340446 +0000 UTC m=+48.204953069" watchObservedRunningTime="2026-11-04 01:10:52.713917675 +0000 UTC m=+48.205466286"
Nov 04 01:10:52.914808 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:52.914779    2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod081d2b6e_a762_4015_8a75_a43b0f6c9e66.slice/crio-f81899f315147c07b4a2b2f46caca257a4417420ff3edf8f5752707681e79594 WatchSource:0}: Error finding container f81899f315147c07b4a2b2f46caca257a4417420ff3edf8f5752707681e79594: Status 404 returned error can't find the container with id f81899f315147c07b4a2b2f46caca257a4417420ff3edf8f5752707681e79594
Nov 04 01:10:52.917754 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:52.917733    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"]
Nov 04 01:10:53.024360 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:53.024333    2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb2a554a_660a_4b82_8e0e_70eaac7d1136.slice/crio-9f6c128be7cfaf7336c3e55c967b569835f1aff4e12f33ced41953dc6d55fe94 WatchSource:0}: Error finding container 9f6c128be7cfaf7336c3e55c967b569835f1aff4e12f33ced41953dc6d55fe94: Status 404 returned error can't find the container with id 9f6c128be7cfaf7336c3e55c967b569835f1aff4e12f33ced41953dc6d55fe94
Nov 04 01:10:53.026081 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.026047    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"]
Nov 04 01:10:53.313592 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.313552    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mmvnr" event={"ID":"39954ddf-ace6-4e62-a9b4-5d12a77b202c","Type":"ContainerStarted","Data":"763c05498fa0833a65aebd46b4a4032584f5122204056f0a5b2bac459c55cdd6"}
Nov 04 01:10:53.314950 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.314915    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f" event={"ID":"db2a554a-660a-4b82-8e0e-70eaac7d1136","Type":"ContainerStarted","Data":"9f6c128be7cfaf7336c3e55c967b569835f1aff4e12f33ced41953dc6d55fe94"}
Nov 04 01:10:53.316405 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.316381    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lc7jc" event={"ID":"1f23f719-7430-4b54-9204-13d0c5bebf96","Type":"ContainerStarted","Data":"595f7603f5f2fe03f14228d78dc5a53c997b3d6b190092a9e5c8c725e0cf375e"}
Nov 04 01:10:53.318004 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.317953    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv" event={"ID":"081d2b6e-a762-4015-8a75-a43b0f6c9e66","Type":"ContainerStarted","Data":"c185b25d9819d34880df9278898669a9e2bb39cef8719c386b7eabef54f97549"}
Nov 04 01:10:53.318108 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.318024    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv" event={"ID":"081d2b6e-a762-4015-8a75-a43b0f6c9e66","Type":"ContainerStarted","Data":"d3256c305acbe84af4096d4373fabb4f3f774512d9fcf9c89e611d5b724e6ec6"}
Nov 04 01:10:53.318108 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.318045    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv" event={"ID":"081d2b6e-a762-4015-8a75-a43b0f6c9e66","Type":"ContainerStarted","Data":"f81899f315147c07b4a2b2f46caca257a4417420ff3edf8f5752707681e79594"}
Nov 04 01:10:53.406727 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.406691    2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-bd6bc57c4-p8hhs"]
Nov 04 01:10:53.409304 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.409282    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:10:53.441042 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.441000    2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mmvnr" podStartSLOduration=2.677924914 podStartE2EDuration="6.440988102s" totalImagesPullingTime="3.763063188s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:10:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:53.440668528 +0000 UTC m=+48.932217138" watchObservedRunningTime="2026-11-04 01:10:53.440988102 +0000 UTC m=+48.932536709"
Nov 04 01:10:53.465209 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.465180    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cvdqx\""
Nov 04 01:10:53.465209 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.465180    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Nov 04 01:10:53.465456 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.465222    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Nov 04 01:10:53.465456 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.465293    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Nov 04 01:10:53.465456 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.465404    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Nov 04 01:10:53.465456 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.465416    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Nov 04 01:10:53.465456 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.465420    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Nov 04 01:10:53.465642 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.465524    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Nov 04 01:10:53.465833 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.465815    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bd6bc57c4-p8hhs"]
Nov 04 01:10:53.510101 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.510078    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f67bd09-93fb-4738-b800-36b41330d329-tmp\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:10:53.510182 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.510120    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8gn5\" (UniqueName: \"kubernetes.io/projected/3f67bd09-93fb-4738-b800-36b41330d329-kube-api-access-r8gn5\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:10:53.510251 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.510217    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-service-ca\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:10:53.510295 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.510260    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f67bd09-93fb-4738-b800-36b41330d329-console-oauth-config\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:10:53.510337 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.510317    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-console-config\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:10:53.510400 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.510387    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-oauth-serving-cert\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:10:53.510430 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.510422    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f67bd09-93fb-4738-b800-36b41330d329-console-serving-cert\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:10:53.611489 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.611442    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-service-ca\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:10:53.611489 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.611470    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f67bd09-93fb-4738-b800-36b41330d329-console-oauth-config\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:10:53.611607 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.611492    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-console-config\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:10:53.611607 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.611521    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-oauth-serving-cert\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:10:53.611693 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.611651    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f67bd09-93fb-4738-b800-36b41330d329-console-serving-cert\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:10:53.611743 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.611687    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f67bd09-93fb-4738-b800-36b41330d329-tmp\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:10:53.611792 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.611737    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8gn5\" (UniqueName: \"kubernetes.io/projected/3f67bd09-93fb-4738-b800-36b41330d329-kube-api-access-r8gn5\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:10:53.612265 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.612236    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-oauth-serving-cert\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:10:53.612265 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.612256    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f67bd09-93fb-4738-b800-36b41330d329-tmp\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:10:53.612403 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.612236    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-service-ca\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:10:53.612403 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.612320    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-console-config\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:10:53.614624 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.614600    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f67bd09-93fb-4738-b800-36b41330d329-console-oauth-config\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:10:53.614703 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.614610    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f67bd09-93fb-4738-b800-36b41330d329-console-serving-cert\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:10:53.675444 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.675417    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8gn5\" (UniqueName: \"kubernetes.io/projected/3f67bd09-93fb-4738-b800-36b41330d329-kube-api-access-r8gn5\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:10:53.719564 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:53.719487    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:10:54.096043 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:54.096007    2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f67bd09_93fb_4738_b800_36b41330d329.slice/crio-abdee1768829bac6ec5dd61ff0d0a0b8fbb57c6e96ec61f407b4e1201295daa0 WatchSource:0}: Error finding container abdee1768829bac6ec5dd61ff0d0a0b8fbb57c6e96ec61f407b4e1201295daa0: Status 404 returned error can't find the container with id abdee1768829bac6ec5dd61ff0d0a0b8fbb57c6e96ec61f407b4e1201295daa0
Nov 04 01:10:54.097441 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.097413    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bd6bc57c4-p8hhs"]
Nov 04 01:10:54.325931 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.325207    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lc7jc" event={"ID":"1f23f719-7430-4b54-9204-13d0c5bebf96","Type":"ContainerStarted","Data":"58b5e3ad667d445aa4f39bfb1d5d17abd4f88648b315c0a2d191c8d6ab9704fc"}
Nov 04 01:10:54.328608 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.328582    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd6bc57c4-p8hhs" event={"ID":"3f67bd09-93fb-4738-b800-36b41330d329","Type":"ContainerStarted","Data":"abdee1768829bac6ec5dd61ff0d0a0b8fbb57c6e96ec61f407b4e1201295daa0"}
Nov 04 01:10:54.637159 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.637081    2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 04 01:10:54.640589 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.640562    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.700071 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.700025    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Nov 04 01:10:54.700071 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.700069    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jfrvw\""
Nov 04 01:10:54.700418 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.700086    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Nov 04 01:10:54.700418 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.700156    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Nov 04 01:10:54.700418 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.700164    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Nov 04 01:10:54.700418 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.700089    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Nov 04 01:10:54.700418 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.700172    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Nov 04 01:10:54.700418 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.700030    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Nov 04 01:10:54.722582 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.722546    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-web-config\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.722768 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.722607    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.722768 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.722713    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.722768 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.722751    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.722938 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.722786    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.722938 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.722837    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f257650-743f-417e-af55-250ef2606e4a-config-out\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.722938 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.722873    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f257650-743f-417e-af55-250ef2606e4a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.722938 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.722894    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f257650-743f-417e-af55-250ef2606e4a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.722938 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.722909    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjkw7\" (UniqueName: \"kubernetes.io/projected/4f257650-743f-417e-af55-250ef2606e4a-kube-api-access-cjkw7\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.722938 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.722931    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-config-volume\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.723247 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.722949    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f257650-743f-417e-af55-250ef2606e4a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.723247 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.722993    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4f257650-743f-417e-af55-250ef2606e4a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.723247 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.723019    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.752698 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.752665    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Nov 04 01:10:54.806386 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.806352    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Nov 04 01:10:54.809556 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.809528    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 04 01:10:54.823625 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.823584    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f257650-743f-417e-af55-250ef2606e4a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.823781 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.823646    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f257650-743f-417e-af55-250ef2606e4a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.823781 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.823674    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjkw7\" (UniqueName: \"kubernetes.io/projected/4f257650-743f-417e-af55-250ef2606e4a-kube-api-access-cjkw7\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.823781 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.823704    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-config-volume\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.823781 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.823725    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f257650-743f-417e-af55-250ef2606e4a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.823781 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.823755    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4f257650-743f-417e-af55-250ef2606e4a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.823781 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.823778    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.824056 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.823803    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-web-config\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.824056 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.823839    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.824056 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.823861    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.824056 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.823876    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.824056 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.823892    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.824056 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.823926    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f257650-743f-417e-af55-250ef2606e4a-config-out\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.824846 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.824510    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f257650-743f-417e-af55-250ef2606e4a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.824846 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.824608    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4f257650-743f-417e-af55-250ef2606e4a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.825258 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.825229    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f257650-743f-417e-af55-250ef2606e4a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.827404 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.827377    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.827404 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.827396    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f257650-743f-417e-af55-250ef2606e4a-config-out\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.827569 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.827548    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-web-config\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.828205 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.828098    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-config-volume\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.828205 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.828157    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.828816 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.828720    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.829414 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.829131    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.829578 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.829551    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.830568 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.830543    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f257650-743f-417e-af55-250ef2606e4a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.888487 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.888425    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjkw7\" (UniqueName: \"kubernetes.io/projected/4f257650-743f-417e-af55-250ef2606e4a-kube-api-access-cjkw7\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:54.962669 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:54.962640    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:10:55.334288 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:55.334251    2571 generic.go:356] "Generic (PLEG): container finished" podID="1f23f719-7430-4b54-9204-13d0c5bebf96" containerID="58b5e3ad667d445aa4f39bfb1d5d17abd4f88648b315c0a2d191c8d6ab9704fc" exitCode=0
Nov 04 01:10:55.334739 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:55.334335    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lc7jc" event={"ID":"1f23f719-7430-4b54-9204-13d0c5bebf96","Type":"ContainerDied","Data":"58b5e3ad667d445aa4f39bfb1d5d17abd4f88648b315c0a2d191c8d6ab9704fc"}
Nov 04 01:10:55.337363 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:55.336887    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv" event={"ID":"081d2b6e-a762-4015-8a75-a43b0f6c9e66","Type":"ContainerStarted","Data":"efe3f5e3d1eb5087f1b85eed5d6fd9883dc6f2ae4111e1b477fbc208947fa13e"}
Nov 04 01:10:55.339987 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:55.339947    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f" event={"ID":"db2a554a-660a-4b82-8e0e-70eaac7d1136","Type":"ContainerStarted","Data":"e68c85e8022b261cb1c6f22fd3868c00ab0a55c629b29b90b3371582dfc30979"}
Nov 04 01:10:55.340084 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:55.340002    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f" event={"ID":"db2a554a-660a-4b82-8e0e-70eaac7d1136","Type":"ContainerStarted","Data":"ac55525d04e8a42ee81e7e68c23a1f6179fd833f606329b3b7c10b91501fb0e0"}
Nov 04 01:10:55.340084 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:55.340028    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f" event={"ID":"db2a554a-660a-4b82-8e0e-70eaac7d1136","Type":"ContainerStarted","Data":"25f6976624d981bc66b3b479cf31cc208fe4dcee56dc0bb5030127e5489f9ef9"}
Nov 04 01:10:55.446674 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:55.443087    2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f257650_743f_417e_af55_250ef2606e4a.slice/crio-3afc624431f8a97662a03146dedd3d5bf1a2e4366d630feac4c31e8595446ef2 WatchSource:0}: Error finding container 3afc624431f8a97662a03146dedd3d5bf1a2e4366d630feac4c31e8595446ef2: Status 404 returned error can't find the container with id 3afc624431f8a97662a03146dedd3d5bf1a2e4366d630feac4c31e8595446ef2
Nov 04 01:10:55.446674 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:55.444660    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 04 01:10:55.582367 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:55.582316    2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv" podStartSLOduration=1.769269649 podStartE2EDuration="3.58230103s" totalImagesPullingTime="1.813031381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:55.581464912 +0000 UTC m=+51.073013523" watchObservedRunningTime="2026-11-04 01:10:55.58230103 +0000 UTC m=+51.073849640"
Nov 04 01:10:56.345241 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:56.345201    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f257650-743f-417e-af55-250ef2606e4a","Type":"ContainerStarted","Data":"3afc624431f8a97662a03146dedd3d5bf1a2e4366d630feac4c31e8595446ef2"}
Nov 04 01:10:56.347923 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:56.347895    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lc7jc" event={"ID":"1f23f719-7430-4b54-9204-13d0c5bebf96","Type":"ContainerStarted","Data":"5771730d63d6c4c7fdea09339f96533b82f25500cfe7ee402b93ac1c94049e9a"}
Nov 04 01:10:56.348100 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:56.348062    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lc7jc" event={"ID":"1f23f719-7430-4b54-9204-13d0c5bebf96","Type":"ContainerStarted","Data":"7dcb89c34f83664eb03d3a9202f0cde5e2ff13ef1913da09878f14dac8747c82"}
Nov 04 01:10:56.478358 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:56.478292    2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lc7jc" podStartSLOduration=2.827641484 podStartE2EDuration="4.478276472s" totalImagesPullingTime="1.568936403s" totalInitContainerRuntime="81.698585ms" isStatefulPod=true podCreationTimestamp="2026-11-04 01:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:56.477570714 +0000 UTC m=+51.969119328" watchObservedRunningTime="2026-11-04 01:10:56.478276472 +0000 UTC m=+51.969825082"
Nov 04 01:10:56.478526 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:56.478412    2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f" podStartSLOduration=2.569928053 podStartE2EDuration="4.478408153s" totalImagesPullingTime="1.9084801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:55.710191597 +0000 UTC m=+51.201740209" watchObservedRunningTime="2026-11-04 01:10:56.478408153 +0000 UTC m=+51.969956762"
Nov 04 01:10:57.117304 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.117273    2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"]
Nov 04 01:10:57.121019 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.120997    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:10:57.144717 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.144686    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtpwr\" (UniqueName: \"kubernetes.io/projected/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-kube-api-access-dtpwr\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:10:57.144717 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.144721    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-audit-log\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:10:57.144889 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.144748    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-client-ca-bundle\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:10:57.144889 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.144838    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:10:57.144889 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.144882    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-secret-metrics-server-tls\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:10:57.145041 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.145003    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-secret-metrics-server-client-certs\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:10:57.145086 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.145052    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-metrics-server-audit-profiles\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:10:57.176543 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.176506    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"]
Nov 04 01:10:57.176747 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.176698    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Nov 04 01:10:57.176878 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.176855    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Nov 04 01:10:57.177028 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.176886    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-j924l\""
Nov 04 01:10:57.177132 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.177045    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Nov 04 01:10:57.177132 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.177072    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1jd3hsdj8to1g\""
Nov 04 01:10:57.177132 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.177100    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Nov 04 01:10:57.245942 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.245899    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-secret-metrics-server-tls\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:10:57.246152 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.245961    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-secret-metrics-server-client-certs\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:10:57.246152 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.246033    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-metrics-server-audit-profiles\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:10:57.246152 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.246070    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtpwr\" (UniqueName: \"kubernetes.io/projected/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-kube-api-access-dtpwr\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:10:57.246152 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.246094    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-audit-log\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:10:57.246152 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.246122    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-client-ca-bundle\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:10:57.246397 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.246311    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:10:57.247070 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.247043    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:10:57.247353 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.247328    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-audit-log\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:10:57.247483 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.247465    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-metrics-server-audit-profiles\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:10:57.249070 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.249017    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-secret-metrics-server-client-certs\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:10:57.249070 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.249063    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-client-ca-bundle\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:10:57.249395 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.249369    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-secret-metrics-server-tls\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:10:57.310457 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.310422    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtpwr\" (UniqueName: \"kubernetes.io/projected/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-kube-api-access-dtpwr\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:10:57.433953 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.433856    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:10:57.860077 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:57.860053    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"]
Nov 04 01:10:57.884713 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:10:57.884684    2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7906bfc4_e4b3_4025_bc1c_37aa0ba8e8fe.slice/crio-e38053e13fa5856c155196fce59ca2714040fd1dbfb4cb45f3da171a8add1be5 WatchSource:0}: Error finding container e38053e13fa5856c155196fce59ca2714040fd1dbfb4cb45f3da171a8add1be5: Status 404 returned error can't find the container with id e38053e13fa5856c155196fce59ca2714040fd1dbfb4cb45f3da171a8add1be5
Nov 04 01:10:58.355202 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:58.355168    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t" event={"ID":"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe","Type":"ContainerStarted","Data":"e38053e13fa5856c155196fce59ca2714040fd1dbfb4cb45f3da171a8add1be5"}
Nov 04 01:10:58.356702 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:58.356678    2571 generic.go:356] "Generic (PLEG): container finished" podID="4f257650-743f-417e-af55-250ef2606e4a" containerID="0fb89146deebf4e8e68877b7ad34f8913492768c82e500ad5f4ca27a85c5ee29" exitCode=0
Nov 04 01:10:58.356830 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:58.356751    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f257650-743f-417e-af55-250ef2606e4a","Type":"ContainerDied","Data":"0fb89146deebf4e8e68877b7ad34f8913492768c82e500ad5f4ca27a85c5ee29"}
Nov 04 01:10:58.360142 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:58.360112    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd6bc57c4-p8hhs" event={"ID":"3f67bd09-93fb-4738-b800-36b41330d329","Type":"ContainerStarted","Data":"98265d5211a8a4baae001fa0653a94d3796e7a5ee12735cdefdda5e10c3f38d2"}
Nov 04 01:10:58.615724 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:10:58.615629    2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-bd6bc57c4-p8hhs" podStartSLOduration=2.144891409 podStartE2EDuration="5.615612821s" totalImagesPullingTime="3.470721412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:58.614797641 +0000 UTC m=+54.106346252" watchObservedRunningTime="2026-11-04 01:10:58.615612821 +0000 UTC m=+54.107161432"
Nov 04 01:11:00.368818 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:00.368782    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t" event={"ID":"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe","Type":"ContainerStarted","Data":"4c78693a19668e4a7e7c3a13686b66090c59b1a6d4cc0bd42fa7922a8fd08b07"}
Nov 04 01:11:00.494545 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:00.493555    2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t" podStartSLOduration=1.506834513 podStartE2EDuration="3.493536499s" totalImagesPullingTime="1.986701986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:10:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:11:00.4926916 +0000 UTC m=+55.984240223" watchObservedRunningTime="2026-11-04 01:11:00.493536499 +0000 UTC m=+55.985085111"
Nov 04 01:11:01.375420 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:01.375387    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f257650-743f-417e-af55-250ef2606e4a","Type":"ContainerStarted","Data":"6721348019b74216cc99c9d8aecd8a09ed8970259d1b5e797547efcb4ae335d0"}
Nov 04 01:11:01.375757 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:01.375451    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f257650-743f-417e-af55-250ef2606e4a","Type":"ContainerStarted","Data":"221768b02f2cc88f8efc79f57bf16ef5033739aa745b1ec48e30bb25566223ed"}
Nov 04 01:11:01.375757 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:01.375481    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f257650-743f-417e-af55-250ef2606e4a","Type":"ContainerStarted","Data":"39b27c8dc348a784ec5d3b007276eb28af5a7d6c0966ecc8014d476614278902"}
Nov 04 01:11:01.375757 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:01.375505    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f257650-743f-417e-af55-250ef2606e4a","Type":"ContainerStarted","Data":"695aa10c2c46cc0035c9c32d38c80b6479389ca53db58a80cb8691fd7fb0823b"}
Nov 04 01:11:01.375757 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:01.375527    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f257650-743f-417e-af55-250ef2606e4a","Type":"ContainerStarted","Data":"2dffe933039fd88de56eb78d51e1b9cf76d47096c9e9d7f4238ce8fdc15fa7b4"}
Nov 04 01:11:02.382115 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.382081    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f257650-743f-417e-af55-250ef2606e4a","Type":"ContainerStarted","Data":"fede5214c3886c74608da76e61076add08da34dcab51c2eee9d5cccabccf3ed7"}
Nov 04 01:11:02.593878 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.593844    2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-865f8db98-82tkl"]
Nov 04 01:11:02.596277 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.596258    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.650541 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.650488    2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.7148593180000002 podStartE2EDuration="8.650473005s" totalImagesPullingTime="5.924117291s" totalInitContainerRuntime="11.496396ms" isStatefulPod=false podCreationTimestamp="2026-11-04 01:10:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:11:02.602873261 +0000 UTC m=+58.094421872" watchObservedRunningTime="2026-11-04 01:11:02.650473005 +0000 UTC m=+58.142021616"
Nov 04 01:11:02.657439 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.657412    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-865f8db98-82tkl"]
Nov 04 01:11:02.698993 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.698945    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-service-ca\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.699126 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.698999    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-oauth-serving-cert\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.699126 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.699065    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-serving-cert\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.699206 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.699131    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-config\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.699206 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.699162    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-trusted-ca-bundle\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.699271 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.699230    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6cefe39-1545-44f8-a04c-d2dc001be4a4-tmp\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.699271 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.699246    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp4rk\" (UniqueName: \"kubernetes.io/projected/d6cefe39-1545-44f8-a04c-d2dc001be4a4-kube-api-access-gp4rk\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.699335 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.699275    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-oauth-config\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.708961 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.708938    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Nov 04 01:11:02.799767 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.799731    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-service-ca\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.799767 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.799767    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-oauth-serving-cert\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.800013 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.799784    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-serving-cert\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.800013 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.799801    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-config\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.800013 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.799819    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-trusted-ca-bundle\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.800013 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.799843    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6cefe39-1545-44f8-a04c-d2dc001be4a4-tmp\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.800013 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.799862    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp4rk\" (UniqueName: \"kubernetes.io/projected/d6cefe39-1545-44f8-a04c-d2dc001be4a4-kube-api-access-gp4rk\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.800013 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.799889    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-oauth-config\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.800617 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.800586    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6cefe39-1545-44f8-a04c-d2dc001be4a4-tmp\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.800617 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.800601    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-service-ca\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.800773 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.800665    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-oauth-serving-cert\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.800773 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.800673    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-config\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.800851 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.800821    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-trusted-ca-bundle\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.802535 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.802515    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-oauth-config\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.802627 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.802609    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-serving-cert\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.864160 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.864101    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp4rk\" (UniqueName: \"kubernetes.io/projected/d6cefe39-1545-44f8-a04c-d2dc001be4a4-kube-api-access-gp4rk\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:02.906352 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:02.906313    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:03.156556 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:03.156483    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xlwwn_4a5b0ed1-dd30-4117-9cd0-e8140080e8ea/dns/0.log"
Nov 04 01:11:03.276224 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:11:03.276197    2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6cefe39_1545_44f8_a04c_d2dc001be4a4.slice/crio-9707c16bb6a9c0396db9741abfe71eee71aedc4f00016666a8bf7e75832b17b6 WatchSource:0}: Error finding container 9707c16bb6a9c0396db9741abfe71eee71aedc4f00016666a8bf7e75832b17b6: Status 404 returned error can't find the container with id 9707c16bb6a9c0396db9741abfe71eee71aedc4f00016666a8bf7e75832b17b6
Nov 04 01:11:03.278908 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:03.278882    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-865f8db98-82tkl"]
Nov 04 01:11:03.331104 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:03.331080    2571 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:11:03.356786 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:03.356759    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xlwwn_4a5b0ed1-dd30-4117-9cd0-e8140080e8ea/kube-rbac-proxy/0.log"
Nov 04 01:11:03.389063 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:03.387933    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-865f8db98-82tkl" event={"ID":"d6cefe39-1545-44f8-a04c-d2dc001be4a4","Type":"ContainerStarted","Data":"528314dac9efd9941794047283734dfa4b8ca89009db36907e4c26242241e60f"}
Nov 04 01:11:03.389063 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:03.388022    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-865f8db98-82tkl" event={"ID":"d6cefe39-1545-44f8-a04c-d2dc001be4a4","Type":"ContainerStarted","Data":"9707c16bb6a9c0396db9741abfe71eee71aedc4f00016666a8bf7e75832b17b6"}
Nov 04 01:11:03.556921 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:03.556891    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dzffv_c242f2eb-7d62-4990-84b0-04175eefc461/dns-node-resolver/0.log"
Nov 04 01:11:03.582532 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:03.582474    2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-865f8db98-82tkl" podStartSLOduration=1.582457653 podStartE2EDuration="1.582457653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:11:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:11:03.581585113 +0000 UTC m=+59.073133722" watchObservedRunningTime="2026-11-04 01:11:03.582457653 +0000 UTC m=+59.074006264"
Nov 04 01:11:03.720573 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:03.720539    2571 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:11:03.720733 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:03.720601    2571 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:11:03.725260 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:03.725236    2571 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:11:04.265822 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:04.265794    2571 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:04.395884 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:04.395856    2571 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:11:04.756325 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:04.756294    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n8xrm_09213485-c715-420e-ab7d-c6cc3ee149a5/node-ca/0.log"
Nov 04 01:11:05.357812 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:05.357779    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-25blp_26e3ee34-ace5-4eda-a96a-6c0014a989ee/serve-healthcheck-canary/0.log"
Nov 04 01:11:07.614824 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.614786    2571 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-865f8db98-82tkl"]
Nov 04 01:11:07.649596 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.649564    2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fd47659d6-bl52s"]
Nov 04 01:11:07.653078 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.653052    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.719950 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.719920    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fd47659d6-bl52s"]
Nov 04 01:11:07.743503 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.743475    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-oauth-serving-cert\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.743641 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.743510    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-console-config\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.743641 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.743527    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b12672cc-5caf-4cce-90b1-babce76c4007-tmp\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.743641 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.743622    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-trusted-ca-bundle\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.743735 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.743688    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-service-ca\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.743735 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.743720    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b12672cc-5caf-4cce-90b1-babce76c4007-console-oauth-config\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.743877 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.743802    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbs8l\" (UniqueName: \"kubernetes.io/projected/b12672cc-5caf-4cce-90b1-babce76c4007-kube-api-access-kbs8l\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.743914 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.743885    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b12672cc-5caf-4cce-90b1-babce76c4007-console-serving-cert\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.845276 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.845241    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b12672cc-5caf-4cce-90b1-babce76c4007-console-serving-cert\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.845447 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.845288    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-oauth-serving-cert\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.845447 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.845318    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-console-config\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.845447 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.845339    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b12672cc-5caf-4cce-90b1-babce76c4007-tmp\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.845447 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.845378    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-trusted-ca-bundle\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.845447 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.845424    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-service-ca\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.845685 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.845469    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b12672cc-5caf-4cce-90b1-babce76c4007-console-oauth-config\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.845685 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.845522    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbs8l\" (UniqueName: \"kubernetes.io/projected/b12672cc-5caf-4cce-90b1-babce76c4007-kube-api-access-kbs8l\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.845913 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.845885    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b12672cc-5caf-4cce-90b1-babce76c4007-tmp\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.846259 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.846236    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-oauth-serving-cert\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.846350 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.846241    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-console-config\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.846350 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.846278    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-trusted-ca-bundle\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.846544 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.846519    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-service-ca\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.847885 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.847861    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b12672cc-5caf-4cce-90b1-babce76c4007-console-serving-cert\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.847885 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.847882    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b12672cc-5caf-4cce-90b1-babce76c4007-console-oauth-config\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.909732 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.909677    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbs8l\" (UniqueName: \"kubernetes.io/projected/b12672cc-5caf-4cce-90b1-babce76c4007-kube-api-access-kbs8l\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:07.963636 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:07.963604    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:08.334188 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:11:08.334156    2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb12672cc_5caf_4cce_90b1_babce76c4007.slice/crio-c5e29cbdf14d41b458afd33c96d760f5b7e1c9109ba069496ad35edc383f3cd6 WatchSource:0}: Error finding container c5e29cbdf14d41b458afd33c96d760f5b7e1c9109ba069496ad35edc383f3cd6: Status 404 returned error can't find the container with id c5e29cbdf14d41b458afd33c96d760f5b7e1c9109ba069496ad35edc383f3cd6
Nov 04 01:11:08.337109 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:08.337091    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fd47659d6-bl52s"]
Nov 04 01:11:08.406774 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:08.406305    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fd47659d6-bl52s" event={"ID":"b12672cc-5caf-4cce-90b1-babce76c4007","Type":"ContainerStarted","Data":"1be81ab88ceff52a2c901fe4a03e29f8f9c7dbbb58fa96b852f23904e94fb3dc"}
Nov 04 01:11:08.406774 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:08.406356    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fd47659d6-bl52s" event={"ID":"b12672cc-5caf-4cce-90b1-babce76c4007","Type":"ContainerStarted","Data":"c5e29cbdf14d41b458afd33c96d760f5b7e1c9109ba069496ad35edc383f3cd6"}
Nov 04 01:11:08.531452 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:08.531401    2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-5fd47659d6-bl52s" podStartSLOduration=1.531388347 podStartE2EDuration="1.531388347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:11:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:11:08.530945851 +0000 UTC m=+64.022494462" watchObservedRunningTime="2026-11-04 01:11:08.531388347 +0000 UTC m=+64.022936957"
Nov 04 01:11:10.872029 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:10.871989    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs\") pod \"network-metrics-daemon-fq4qm\" (UID: \"96855631-beca-4d91-814d-689668f6de56\") " pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:11:10.926831 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:10.926798    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 04 01:11:10.934774 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:10.934741    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs\") pod \"network-metrics-daemon-fq4qm\" (UID: \"96855631-beca-4d91-814d-689668f6de56\") " pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:11:10.972707 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:10.972671    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret\") pod \"global-pull-secret-syncer-nrlb9\" (UID: \"42e12e95-3cc8-4393-93fb-087e19f92874\") " pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:11:11.027514 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:11.027484    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 04 01:11:11.035784 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:11.035759    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret\") pod \"global-pull-secret-syncer-nrlb9\" (UID: \"42e12e95-3cc8-4393-93fb-087e19f92874\") " pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:11:11.073107 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:11.073074    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56tjz\" (UniqueName: \"kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz\") pod \"network-check-target-zq545\" (UID: \"2db16eff-7518-4f50-b080-8208d5e756cc\") " pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:11:11.128072 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:11.127998    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 04 01:11:11.188620 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:11.188590    2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 04 01:11:11.197360 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:11.197329    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56tjz\" (UniqueName: \"kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz\") pod \"network-check-target-zq545\" (UID: \"2db16eff-7518-4f50-b080-8208d5e756cc\") " pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:11:11.248335 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:11.248300    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8lz6w\""
Nov 04 01:11:11.252343 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:11.252318    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-8hhs6\""
Nov 04 01:11:11.254528 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:11.254513    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:11:11.258060 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:11.258039    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:11:11.538744 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:11.538711    2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-x4nsn\""
Nov 04 01:11:11.544841 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:11.544818    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:11:11.630610 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:11:11.630568    2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42e12e95_3cc8_4393_93fb_087e19f92874.slice/crio-34186d5a792d0c8e062544d6dccaac193464a72068403d3e05829ccc46ec802c WatchSource:0}: Error finding container 34186d5a792d0c8e062544d6dccaac193464a72068403d3e05829ccc46ec802c: Status 404 returned error can't find the container with id 34186d5a792d0c8e062544d6dccaac193464a72068403d3e05829ccc46ec802c
Nov 04 01:11:11.634002 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:11.633949    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nrlb9"]
Nov 04 01:11:11.679998 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:11:11.679946    2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96855631_beca_4d91_814d_689668f6de56.slice/crio-7981587290d1c0f49e91c27e574f7842c514ef89376ab3235318bc7485da4356 WatchSource:0}: Error finding container 7981587290d1c0f49e91c27e574f7842c514ef89376ab3235318bc7485da4356: Status 404 returned error can't find the container with id 7981587290d1c0f49e91c27e574f7842c514ef89376ab3235318bc7485da4356
Nov 04 01:11:11.683230 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:11.683211    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fq4qm"]
Nov 04 01:11:11.910800 ip-10-0-131-51 kubenswrapper[2571]: W1104 01:11:11.910771    2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2db16eff_7518_4f50_b080_8208d5e756cc.slice/crio-ad22e71cff5ad7843215a4d818d74404e5a6a5a3ad3d5ff31e231382eefb9d66 WatchSource:0}: Error finding container ad22e71cff5ad7843215a4d818d74404e5a6a5a3ad3d5ff31e231382eefb9d66: Status 404 returned error can't find the container with id ad22e71cff5ad7843215a4d818d74404e5a6a5a3ad3d5ff31e231382eefb9d66
Nov 04 01:11:11.913672 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:11.913651    2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zq545"]
Nov 04 01:11:12.423689 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:12.423650    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fq4qm" event={"ID":"96855631-beca-4d91-814d-689668f6de56","Type":"ContainerStarted","Data":"7981587290d1c0f49e91c27e574f7842c514ef89376ab3235318bc7485da4356"}
Nov 04 01:11:12.424871 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:12.424835    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nrlb9" event={"ID":"42e12e95-3cc8-4393-93fb-087e19f92874","Type":"ContainerStarted","Data":"34186d5a792d0c8e062544d6dccaac193464a72068403d3e05829ccc46ec802c"}
Nov 04 01:11:12.426094 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:12.426071    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zq545" event={"ID":"2db16eff-7518-4f50-b080-8208d5e756cc","Type":"ContainerStarted","Data":"ad22e71cff5ad7843215a4d818d74404e5a6a5a3ad3d5ff31e231382eefb9d66"}
Nov 04 01:11:12.907501 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:12.907462    2571 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:14.438483 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:14.438451    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fq4qm" event={"ID":"96855631-beca-4d91-814d-689668f6de56","Type":"ContainerStarted","Data":"6456cc6b78736e4e06555a8513ff4085a31f5dc8b88764b2fe23b99add6ff339"}
Nov 04 01:11:14.438963 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:14.438510    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fq4qm" event={"ID":"96855631-beca-4d91-814d-689668f6de56","Type":"ContainerStarted","Data":"b0437eade2867845558ae2bb2474e1f0095a3a5e981623f36a2f8b393dd624d3"}
Nov 04 01:11:14.561835 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:14.561775    2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fq4qm" podStartSLOduration=66.591689907 podStartE2EDuration="1m8.561759241s" totalImagesPullingTime="1.970069334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:11:14.560267521 +0000 UTC m=+70.051816127" watchObservedRunningTime="2026-11-04 01:11:14.561759241 +0000 UTC m=+70.053307853"
Nov 04 01:11:16.448811 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:16.448773    2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zq545" event={"ID":"2db16eff-7518-4f50-b080-8208d5e756cc","Type":"ContainerStarted","Data":"c3c7ceb18efa852f29f056396296c71cb26c36db88c82e3ba7c6e5f3acadeb43"}
Nov 04 01:11:16.449383 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:16.448923    2571 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:11:16.570984 ip-10-0-131-51 kubenswrapper[2571]: I1104 01:11:16.570914    2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zq545" podStartSLOduration=66.661534366 podStartE2EDuration="1m10.570900816s" totalImagesPullingTime="3.90936645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:11:16.570340832 +0000 UTC m=+72.061889444" watchObservedRunningTime="2026-11-04 01:11:16.570900816 +0000 UTC m=+72.062449455"
Nov 04 01:11:17.392531 ip-10-0-131-51 systemd[1]: Stopping Kubernetes Kubelet...
Nov 04 01:11:17.404291 ip-10-0-131-51 systemd[1]: kubelet.service: Deactivated successfully.
Nov 04 01:11:17.404458 ip-10-0-131-51 systemd[1]: Stopped Kubernetes Kubelet.
Nov 04 01:11:17.404642 ip-10-0-131-51 systemd[1]: kubelet.service: Consumed 4.031s CPU time.
Nov 04 01:11:17.415820 ip-10-0-131-51 systemd[1]: Starting Kubernetes Kubelet...
Nov 04 01:11:17.478264 ip-10-0-131-51 kubenswrapper[5640]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 01:11:17.478264 ip-10-0-131-51 kubenswrapper[5640]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 04 01:11:17.478264 ip-10-0-131-51 kubenswrapper[5640]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 01:11:17.478264 ip-10-0-131-51 kubenswrapper[5640]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 01:11:17.480421 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480325    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:11:17.480421 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480418    5640 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:11:17.480421 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480423    5640 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:11:17.480421 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480427    5640 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:11:17.480542 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480430    5640 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:11:17.480542 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480433    5640 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:11:17.480542 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480439    5640 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:11:17.480542 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480442    5640 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:11:17.480542 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480445    5640 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:11:17.480542 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480448    5640 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:11:17.480542 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480451    5640 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:11:17.480542 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480453    5640 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:11:17.480542 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480456    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:11:17.480542 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480459    5640 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:11:17.480542 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480461    5640 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:11:17.480542 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480464    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:11:17.480542 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480466    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:11:17.480542 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480469    5640 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:11:17.480542 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480472    5640 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:11:17.480542 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480476    5640 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:11:17.480542 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480481    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:11:17.480542 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480485    5640 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:11:17.480542 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480488    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:11:17.480542 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480491    5640 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:11:17.481100 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480497    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:11:17.481100 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480500    5640 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:11:17.481100 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480503    5640 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:11:17.481100 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480506    5640 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:11:17.481100 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480509    5640 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:11:17.481100 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480512    5640 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:11:17.481100 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480515    5640 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:11:17.481100 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480517    5640 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:11:17.481100 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480520    5640 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:11:17.481100 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480523    5640 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:11:17.481100 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480526    5640 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:11:17.481100 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480529    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:11:17.481100 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480531    5640 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:11:17.481100 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480534    5640 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:11:17.481100 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480537    5640 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:11:17.481100 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480540    5640 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:11:17.481100 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480542    5640 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:11:17.481100 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480545    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:11:17.481100 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480548    5640 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:11:17.481100 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480551    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:11:17.481605 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480554    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:11:17.481605 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480557    5640 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:11:17.481605 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480560    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:11:17.481605 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480562    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:11:17.481605 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480565    5640 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:11:17.481605 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480568    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:11:17.481605 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480570    5640 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:11:17.481605 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480573    5640 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:11:17.481605 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480576    5640 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:11:17.481605 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480578    5640 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:11:17.481605 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480581    5640 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:11:17.481605 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480584    5640 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:11:17.481605 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480587    5640 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:11:17.481605 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480590    5640 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:11:17.481605 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480592    5640 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:11:17.481605 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480595    5640 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:11:17.481605 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480598    5640 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:11:17.481605 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480600    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:11:17.481605 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480603    5640 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:11:17.482084 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480606    5640 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:11:17.482084 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480608    5640 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:11:17.482084 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480611    5640 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:11:17.482084 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480614    5640 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:11:17.482084 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480616    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:11:17.482084 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480621    5640 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:11:17.482084 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480625    5640 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:11:17.482084 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480628    5640 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:11:17.482084 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480631    5640 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:11:17.482084 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480634    5640 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:11:17.482084 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480637    5640 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:11:17.482084 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480639    5640 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:11:17.482084 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480642    5640 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:11:17.482084 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480645    5640 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:11:17.482084 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480648    5640 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:11:17.482084 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480650    5640 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:11:17.482084 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480653    5640 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:11:17.482084 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480655    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:11:17.482084 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480658    5640 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:11:17.482585 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480661    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:11:17.482585 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480663    5640 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:11:17.482585 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480666    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:11:17.482585 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480669    5640 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:11:17.482585 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480671    5640 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:11:17.482585 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480674    5640 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:11:17.482585 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480676    5640 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:11:17.482585 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480679    5640 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:11:17.482585 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480682    5640 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:11:17.482585 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480685    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:11:17.482585 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480688    5640 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:11:17.482585 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480691    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:11:17.482585 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480693    5640 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:11:17.482585 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480696    5640 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:11:17.482585 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480699    5640 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:11:17.482585 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480702    5640 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:11:17.482585 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480704    5640 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:11:17.482585 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480707    5640 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:11:17.482585 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480710    5640 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:11:17.482585 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480713    5640 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:11:17.483090 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480716    5640 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:11:17.483090 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480718    5640 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:11:17.483090 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480721    5640 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:11:17.483090 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.480724    5640 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:11:17.483090 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481519    5640 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:11:17.483090 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481528    5640 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:11:17.483090 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481531    5640 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:11:17.483090 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481534    5640 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:11:17.483090 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481537    5640 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:11:17.483090 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481540    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:11:17.483090 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481543    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:11:17.483090 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481545    5640 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:11:17.483090 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481551    5640 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:11:17.483090 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481553    5640 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:11:17.483090 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481556    5640 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:11:17.483090 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481559    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:11:17.483090 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481562    5640 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:11:17.483090 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481564    5640 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:11:17.483090 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481567    5640 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:11:17.483090 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481570    5640 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:11:17.483586 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481574    5640 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:11:17.483586 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481577    5640 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:11:17.483586 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481579    5640 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:11:17.483586 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481582    5640 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:11:17.483586 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481584    5640 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:11:17.483586 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481587    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:11:17.483586 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481589    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:11:17.483586 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481592    5640 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:11:17.483586 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481594    5640 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:11:17.483586 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481597    5640 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:11:17.483586 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481600    5640 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:11:17.483586 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481602    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:11:17.483586 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481605    5640 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:11:17.483586 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481608    5640 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:11:17.483586 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481611    5640 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:11:17.483586 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481614    5640 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:11:17.483586 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481618    5640 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:11:17.483586 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481620    5640 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:11:17.483586 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481623    5640 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:11:17.484067 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481626    5640 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:11:17.484067 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481628    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:11:17.484067 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481631    5640 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:11:17.484067 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481634    5640 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:11:17.484067 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481636    5640 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:11:17.484067 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481641    5640 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:11:17.484067 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481644    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:11:17.484067 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481646    5640 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:11:17.484067 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481649    5640 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:11:17.484067 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481651    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:11:17.484067 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481654    5640 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:11:17.484067 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481656    5640 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:11:17.484067 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481659    5640 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:11:17.484067 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481664    5640 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:11:17.484067 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481668    5640 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:11:17.484067 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481672    5640 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:11:17.484067 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481675    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:11:17.484067 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481678    5640 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:11:17.484067 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481680    5640 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:11:17.484536 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481683    5640 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:11:17.484536 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481686    5640 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:11:17.484536 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481688    5640 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:11:17.484536 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481691    5640 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:11:17.484536 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481693    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:11:17.484536 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481696    5640 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:11:17.484536 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481699    5640 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:11:17.484536 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481701    5640 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:11:17.484536 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481704    5640 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:11:17.484536 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481708    5640 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:11:17.484536 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481713    5640 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:11:17.484536 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481716    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:11:17.484536 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481719    5640 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:11:17.484536 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481721    5640 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:11:17.484536 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481724    5640 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:11:17.484536 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481727    5640 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:11:17.484536 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481730    5640 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:11:17.484536 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481732    5640 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:11:17.484536 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481737    5640 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:11:17.485016 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481740    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:11:17.485016 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481743    5640 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:11:17.485016 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481745    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:11:17.485016 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481748    5640 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:11:17.485016 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481750    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:11:17.485016 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481753    5640 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:11:17.485016 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481756    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:11:17.485016 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481758    5640 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:11:17.485016 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481761    5640 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:11:17.485016 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481764    5640 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:11:17.485016 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481766    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:11:17.485016 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481769    5640 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:11:17.485016 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481772    5640 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:11:17.485016 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481774    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:11:17.485016 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481777    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:11:17.485016 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481779    5640 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:11:17.485016 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481782    5640 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:11:17.485016 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481785    5640 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:11:17.485016 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481787    5640 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:11:17.485016 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481790    5640 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:11:17.485510 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481792    5640 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:11:17.485510 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481795    5640 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:11:17.485510 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481797    5640 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:11:17.485510 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481800    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:11:17.485510 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481803    5640 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:11:17.485510 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481806    5640 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:11:17.485510 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481808    5640 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:11:17.485510 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481811    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:11:17.485510 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481814    5640 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:11:17.485510 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481816    5640 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:11:17.485510 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481818    5640 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:11:17.485510 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481824    5640 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:11:17.485510 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.481827    5640 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:11:17.485510 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482377    5640 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:11:17.485510 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482384    5640 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:11:17.485510 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482387    5640 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:11:17.485510 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482390    5640 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:11:17.485510 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482392    5640 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:11:17.485510 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482396    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:11:17.485999 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482400    5640 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:11:17.485999 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482402    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:11:17.485999 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482405    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:11:17.485999 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482408    5640 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:11:17.485999 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482410    5640 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:11:17.485999 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482413    5640 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:11:17.485999 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482416    5640 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:11:17.485999 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482418    5640 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:11:17.485999 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482421    5640 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:11:17.485999 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482424    5640 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:11:17.485999 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482426    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:11:17.485999 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482429    5640 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:11:17.485999 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482432    5640 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:11:17.485999 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482434    5640 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:11:17.485999 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482437    5640 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:11:17.485999 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482439    5640 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:11:17.485999 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482441    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:11:17.485999 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482444    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:11:17.485999 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482453    5640 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:11:17.486494 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482456    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:11:17.486494 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482459    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:11:17.486494 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482461    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:11:17.486494 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482464    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:11:17.486494 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482466    5640 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:11:17.486494 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482471    5640 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:11:17.486494 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482474    5640 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:11:17.486494 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482476    5640 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:11:17.486494 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482479    5640 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:11:17.486494 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482481    5640 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:11:17.486494 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482484    5640 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:11:17.486494 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482487    5640 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:11:17.486494 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482489    5640 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:11:17.486494 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482492    5640 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:11:17.486494 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482494    5640 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:11:17.486494 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482497    5640 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:11:17.486494 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482499    5640 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:11:17.486494 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482502    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:11:17.486494 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482505    5640 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:11:17.486494 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482507    5640 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:11:17.487379 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482510    5640 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:11:17.487379 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482512    5640 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:11:17.487379 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482515    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:11:17.487379 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482517    5640 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:11:17.487379 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482520    5640 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:11:17.487379 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482522    5640 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:11:17.487379 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482525    5640 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:11:17.487379 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482527    5640 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:11:17.487379 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482530    5640 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:11:17.487379 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482532    5640 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:11:17.487379 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482535    5640 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:11:17.487379 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482537    5640 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:11:17.487379 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482549    5640 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:11:17.487379 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482552    5640 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:11:17.487379 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482554    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:11:17.487379 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482557    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:11:17.487379 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482559    5640 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:11:17.487379 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482563    5640 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:11:17.487379 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482566    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:11:17.488244 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482568    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:11:17.488244 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482571    5640 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:11:17.488244 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482574    5640 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:11:17.488244 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482576    5640 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:11:17.488244 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482579    5640 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:11:17.488244 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482582    5640 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:11:17.488244 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482585    5640 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:11:17.488244 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482588    5640 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:11:17.488244 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482591    5640 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:11:17.488244 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482593    5640 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:11:17.488244 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482596    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:11:17.488244 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482599    5640 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:11:17.488244 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482602    5640 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:11:17.488244 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482604    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:11:17.488244 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482607    5640 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:11:17.488244 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482609    5640 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:11:17.488244 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482612    5640 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:11:17.488244 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482616    5640 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:11:17.488244 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482620    5640 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:11:17.489146 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482623    5640 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:11:17.489146 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482627    5640 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:11:17.489146 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482630    5640 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:11:17.489146 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482632    5640 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:11:17.489146 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482635    5640 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:11:17.489146 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482638    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:11:17.489146 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482641    5640 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:11:17.489146 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482649    5640 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:11:17.489146 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482652    5640 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:11:17.489146 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482656    5640 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:11:17.489146 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482659    5640 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:11:17.489146 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482663    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:11:17.489146 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482666    5640 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:11:17.489146 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482668    5640 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:11:17.489146 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482670    5640 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:11:17.489146 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482673    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:11:17.489146 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482675    5640 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:11:17.489146 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482680    5640 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:11:17.489146 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482682    5640 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:11:17.489146 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482685    5640 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:11:17.490051 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482688    5640 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:11:17.490051 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482691    5640 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:11:17.490051 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.482694    5640 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:11:17.490051 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482803    5640 flags.go:64] FLAG: --address="0.0.0.0"
Nov 04 01:11:17.490051 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482813    5640 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 04 01:11:17.490051 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482820    5640 flags.go:64] FLAG: --anonymous-auth="true"
Nov 04 01:11:17.490051 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482825    5640 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 04 01:11:17.490051 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482830    5640 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 04 01:11:17.490051 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482833    5640 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 04 01:11:17.490051 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482839    5640 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 04 01:11:17.490051 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482844    5640 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 04 01:11:17.490051 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482847    5640 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 04 01:11:17.490051 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482850    5640 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 04 01:11:17.490051 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482854    5640 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 04 01:11:17.490051 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482857    5640 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 04 01:11:17.490051 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482860    5640 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 04 01:11:17.490051 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482863    5640 flags.go:64] FLAG: --cgroup-root=""
Nov 04 01:11:17.490051 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482866    5640 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 04 01:11:17.490051 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482869    5640 flags.go:64] FLAG: --client-ca-file=""
Nov 04 01:11:17.490051 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482872    5640 flags.go:64] FLAG: --cloud-provider="external"
Nov 04 01:11:17.490051 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482876    5640 flags.go:64] FLAG: --cluster-dns="[]"
Nov 04 01:11:17.490051 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482881    5640 flags.go:64] FLAG: --cluster-domain=""
Nov 04 01:11:17.490051 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482884    5640 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 04 01:11:17.491128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482887    5640 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 04 01:11:17.491128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482891    5640 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 04 01:11:17.491128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482894    5640 flags.go:64] FLAG: --container-log-max-files="5"
Nov 04 01:11:17.491128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482898    5640 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 04 01:11:17.491128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482902    5640 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 04 01:11:17.491128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482905    5640 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 04 01:11:17.491128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482911    5640 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 04 01:11:17.491128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482915    5640 flags.go:64] FLAG: --contention-profiling="false"
Nov 04 01:11:17.491128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482917    5640 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 04 01:11:17.491128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482921    5640 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 04 01:11:17.491128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482924    5640 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 04 01:11:17.491128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482927    5640 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 04 01:11:17.491128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482932    5640 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 04 01:11:17.491128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482935    5640 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 04 01:11:17.491128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482938    5640 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 04 01:11:17.491128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482941    5640 flags.go:64] FLAG: --enable-load-reader="false"
Nov 04 01:11:17.491128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482945    5640 flags.go:64] FLAG: --enable-server="true"
Nov 04 01:11:17.491128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482948    5640 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 04 01:11:17.491128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482952    5640 flags.go:64] FLAG: --event-burst="100"
Nov 04 01:11:17.491128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482955    5640 flags.go:64] FLAG: --event-qps="50"
Nov 04 01:11:17.491128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482959    5640 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 04 01:11:17.491128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482962    5640 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 04 01:11:17.491128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482978    5640 flags.go:64] FLAG: --eviction-hard=""
Nov 04 01:11:17.491128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482983    5640 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 04 01:11:17.492191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482986    5640 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 04 01:11:17.492191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482990    5640 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 04 01:11:17.492191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482993    5640 flags.go:64] FLAG: --eviction-soft=""
Nov 04 01:11:17.492191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482996    5640 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 04 01:11:17.492191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.482999    5640 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 04 01:11:17.492191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483002    5640 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 04 01:11:17.492191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483006    5640 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 04 01:11:17.492191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483009    5640 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 04 01:11:17.492191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483012    5640 flags.go:64] FLAG: --fail-swap-on="true"
Nov 04 01:11:17.492191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483015    5640 flags.go:64] FLAG: --feature-gates=""
Nov 04 01:11:17.492191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483020    5640 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 04 01:11:17.492191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483023    5640 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 04 01:11:17.492191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483026    5640 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 04 01:11:17.492191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483029    5640 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 04 01:11:17.492191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483035    5640 flags.go:64] FLAG: --healthz-port="10248"
Nov 04 01:11:17.492191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483038    5640 flags.go:64] FLAG: --help="false"
Nov 04 01:11:17.492191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483041    5640 flags.go:64] FLAG: --hostname-override="ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:11:17.492191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483045    5640 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 04 01:11:17.492191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483048    5640 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 04 01:11:17.492191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483052    5640 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 04 01:11:17.492191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483056    5640 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 04 01:11:17.492191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483059    5640 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 04 01:11:17.492191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483062    5640 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483065    5640 flags.go:64] FLAG: --image-service-endpoint=""
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483068    5640 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483071    5640 flags.go:64] FLAG: --kube-api-burst="100"
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483074    5640 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483077    5640 flags.go:64] FLAG: --kube-api-qps="50"
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483080    5640 flags.go:64] FLAG: --kube-reserved=""
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483083    5640 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483086    5640 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483089    5640 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483092    5640 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483095    5640 flags.go:64] FLAG: --lock-file=""
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483098    5640 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483101    5640 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483105    5640 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483110    5640 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483113    5640 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483117    5640 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483120    5640 flags.go:64] FLAG: --logging-format="text"
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483123    5640 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483126    5640 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483129    5640 flags.go:64] FLAG: --manifest-url=""
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483132    5640 flags.go:64] FLAG: --manifest-url-header=""
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483137    5640 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483140    5640 flags.go:64] FLAG: --max-open-files="1000000"
Nov 04 01:11:17.493186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483144    5640 flags.go:64] FLAG: --max-pods="110"
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483147    5640 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483150    5640 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483154    5640 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483157    5640 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483160    5640 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483163    5640 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483165    5640 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483173    5640 flags.go:64] FLAG: --node-status-max-images="50"
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483176    5640 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483179    5640 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483185    5640 flags.go:64] FLAG: --pod-cidr=""
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483188    5640 flags.go:64] FLAG: --pod-manifest-path=""
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483191    5640 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483194    5640 flags.go:64] FLAG: --pods-per-core="0"
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483197    5640 flags.go:64] FLAG: --port="10250"
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483200    5640 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483203    5640 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-0751df68730cc5e3a"
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483206    5640 flags.go:64] FLAG: --qos-reserved=""
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483209    5640 flags.go:64] FLAG: --read-only-port="10255"
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483212    5640 flags.go:64] FLAG: --register-node="true"
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483215    5640 flags.go:64] FLAG: --register-with-taints=""
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483219    5640 flags.go:64] FLAG: --registry-burst="10"
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483222    5640 flags.go:64] FLAG: --registry-qps="5"
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483225    5640 flags.go:64] FLAG: --reserved-cpus=""
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483229    5640 flags.go:64] FLAG: --reserved-memory=""
Nov 04 01:11:17.494257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483233    5640 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483236    5640 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483240    5640 flags.go:64] FLAG: --rotate-certificates="false"
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483243    5640 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483245    5640 flags.go:64] FLAG: --runonce="false"
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483248    5640 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483252    5640 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483255    5640 flags.go:64] FLAG: --seccomp-default="false"
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483258    5640 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483261    5640 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483264    5640 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483267    5640 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483271    5640 flags.go:64] FLAG: --storage-driver-password="root"
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483273    5640 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483276    5640 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483279    5640 flags.go:64] FLAG: --storage-driver-user="root"
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483283    5640 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483287    5640 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483291    5640 flags.go:64] FLAG: --system-cgroups=""
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483293    5640 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483299    5640 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483302    5640 flags.go:64] FLAG: --tls-cert-file=""
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483305    5640 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483310    5640 flags.go:64] FLAG: --tls-min-version=""
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483313    5640 flags.go:64] FLAG: --tls-private-key-file=""
Nov 04 01:11:17.495403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483316    5640 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 04 01:11:17.496485 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483319    5640 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 04 01:11:17.496485 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483322    5640 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 04 01:11:17.496485 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483325    5640 flags.go:64] FLAG: --v="2"
Nov 04 01:11:17.496485 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483330    5640 flags.go:64] FLAG: --version="false"
Nov 04 01:11:17.496485 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483334    5640 flags.go:64] FLAG: --vmodule=""
Nov 04 01:11:17.496485 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483338    5640 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 04 01:11:17.496485 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483346    5640 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 04 01:11:17.496485 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483519    5640 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:11:17.496485 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483522    5640 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:11:17.496485 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483525    5640 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:11:17.496485 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483528    5640 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:11:17.496485 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483530    5640 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:11:17.496485 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483533    5640 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:11:17.496485 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483536    5640 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:11:17.496485 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483538    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:11:17.496485 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483541    5640 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:11:17.496485 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483543    5640 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:11:17.496485 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483546    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:11:17.496485 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483549    5640 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:11:17.496485 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483552    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:11:17.496485 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483554    5640 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:11:17.497216 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483557    5640 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:11:17.497216 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483559    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:11:17.497216 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483563    5640 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:11:17.497216 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483566    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:11:17.497216 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483568    5640 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:11:17.497216 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483571    5640 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:11:17.497216 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483574    5640 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:11:17.497216 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483576    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:11:17.497216 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483579    5640 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:11:17.497216 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483581    5640 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:11:17.497216 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483584    5640 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:11:17.497216 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483587    5640 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:11:17.497216 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483590    5640 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:11:17.497216 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483592    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:11:17.497216 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483595    5640 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:11:17.497216 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483598    5640 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:11:17.497216 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483601    5640 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:11:17.497216 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483604    5640 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:11:17.497216 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483617    5640 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:11:17.497216 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483621    5640 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:11:17.497726 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483624    5640 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:11:17.497726 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483627    5640 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:11:17.497726 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483629    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:11:17.497726 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483632    5640 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:11:17.497726 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483635    5640 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:11:17.497726 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483637    5640 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:11:17.497726 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483640    5640 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:11:17.497726 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483642    5640 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:11:17.497726 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483645    5640 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:11:17.497726 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483648    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:11:17.497726 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483650    5640 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:11:17.497726 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483653    5640 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:11:17.497726 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483656    5640 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:11:17.497726 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483658    5640 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:11:17.497726 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483663    5640 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:11:17.497726 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483665    5640 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:11:17.497726 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483668    5640 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:11:17.497726 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483671    5640 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:11:17.497726 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483674    5640 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:11:17.497726 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483676    5640 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:11:17.498304 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483679    5640 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:11:17.498304 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483682    5640 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:11:17.498304 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483684    5640 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:11:17.498304 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483688    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:11:17.498304 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483691    5640 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:11:17.498304 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483694    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:11:17.498304 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483697    5640 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:11:17.498304 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483700    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:11:17.498304 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483703    5640 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:11:17.498304 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483705    5640 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:11:17.498304 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483708    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:11:17.498304 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483712    5640 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:11:17.498304 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483715    5640 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:11:17.498304 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483718    5640 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:11:17.498304 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483721    5640 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:11:17.498304 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483723    5640 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:11:17.498304 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483726    5640 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:11:17.498304 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483729    5640 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:11:17.498304 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483731    5640 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:11:17.498940 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483734    5640 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:11:17.498940 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483736    5640 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:11:17.498940 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483739    5640 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:11:17.498940 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483742    5640 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:11:17.498940 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483744    5640 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:11:17.498940 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483747    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:11:17.498940 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483749    5640 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:11:17.498940 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483753    5640 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:11:17.498940 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483756    5640 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:11:17.498940 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483758    5640 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:11:17.498940 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483761    5640 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:11:17.498940 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483764    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:11:17.498940 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483766    5640 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:11:17.498940 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483769    5640 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:11:17.498940 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483772    5640 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:11:17.498940 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483775    5640 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:11:17.498940 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483778    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:11:17.498940 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483781    5640 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:11:17.498940 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483785    5640 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:11:17.499456 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483790    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:11:17.499456 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483793    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:11:17.499456 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483796    5640 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:11:17.499456 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483799    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:11:17.499456 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483802    5640 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:11:17.499456 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483804    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:11:17.499456 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483808    5640 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:11:17.499456 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483811    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:11:17.499456 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483813    5640 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:11:17.499456 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483816    5640 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:11:17.499456 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483818    5640 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:11:17.499456 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483821    5640 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:11:17.499456 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483823    5640 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:11:17.499456 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483827    5640 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:11:17.499456 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.483854    5640 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 01:11:17.499456 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483907    5640 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:11:17.499845 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483911    5640 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:11:17.499845 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483914    5640 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:11:17.499845 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483917    5640 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:11:17.499845 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483920    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:11:17.499845 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483922    5640 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:11:17.499845 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483926    5640 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:11:17.499845 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483929    5640 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:11:17.499845 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483932    5640 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:11:17.499845 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483934    5640 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:11:17.499845 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483937    5640 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:11:17.499845 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483940    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:11:17.499845 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483942    5640 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:11:17.499845 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483945    5640 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:11:17.499845 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483950    5640 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:11:17.499845 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483952    5640 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:11:17.499845 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483955    5640 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:11:17.499845 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483958    5640 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:11:17.499845 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483960    5640 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:11:17.499845 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483963    5640 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:11:17.499845 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483982    5640 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:11:17.500545 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483985    5640 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:11:17.500545 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483989    5640 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:11:17.500545 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483993    5640 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:11:17.500545 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.483998    5640 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:11:17.500545 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484001    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:11:17.500545 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484005    5640 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:11:17.500545 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484009    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:11:17.500545 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484012    5640 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:11:17.500545 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484015    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:11:17.500545 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484018    5640 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:11:17.500545 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484021    5640 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:11:17.500545 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484023    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:11:17.500545 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484026    5640 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:11:17.500545 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484029    5640 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:11:17.500545 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484032    5640 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:11:17.500545 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484034    5640 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:11:17.500545 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484037    5640 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:11:17.500545 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484041    5640 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:11:17.500545 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484044    5640 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:11:17.501180 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484047    5640 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:11:17.501180 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484049    5640 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:11:17.501180 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484052    5640 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:11:17.501180 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484055    5640 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:11:17.501180 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484057    5640 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:11:17.501180 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484060    5640 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:11:17.501180 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484064    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:11:17.501180 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484067    5640 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:11:17.501180 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484070    5640 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:11:17.501180 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484072    5640 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:11:17.501180 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484075    5640 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:11:17.501180 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484078    5640 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:11:17.501180 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484081    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:11:17.501180 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484084    5640 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:11:17.501180 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484086    5640 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:11:17.501180 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484089    5640 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:11:17.501180 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484092    5640 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:11:17.501180 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484095    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:11:17.501180 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484098    5640 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:11:17.501681 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484104    5640 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:11:17.501681 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484107    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:11:17.501681 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484111    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:11:17.501681 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484115    5640 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:11:17.501681 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484117    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:11:17.501681 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484120    5640 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:11:17.501681 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484123    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:11:17.501681 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484126    5640 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:11:17.501681 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484128    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:11:17.501681 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484131    5640 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:11:17.501681 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484133    5640 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:11:17.501681 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484139    5640 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:11:17.501681 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484142    5640 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:11:17.501681 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484144    5640 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:11:17.501681 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484148    5640 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:11:17.501681 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484151    5640 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:11:17.501681 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484155    5640 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:11:17.501681 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484157    5640 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:11:17.501681 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484160    5640 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:11:17.502176 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484164    5640 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:11:17.502176 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484167    5640 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:11:17.502176 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484169    5640 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:11:17.502176 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484172    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:11:17.502176 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484175    5640 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:11:17.502176 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484177    5640 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:11:17.502176 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484180    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:11:17.502176 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484183    5640 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:11:17.502176 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484186    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:11:17.502176 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484188    5640 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:11:17.502176 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484191    5640 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:11:17.502176 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484193    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:11:17.502176 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484196    5640 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:11:17.502176 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484199    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:11:17.502176 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484202    5640 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:11:17.502176 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484204    5640 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:11:17.502176 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484207    5640 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:11:17.502176 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484210    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:11:17.502176 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484212    5640 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:11:17.502176 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484215    5640 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:11:17.502661 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484217    5640 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:11:17.502661 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484220    5640 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:11:17.502661 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484222    5640 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:11:17.502661 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484225    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:11:17.502661 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484230    5640 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:11:17.502661 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484233    5640 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:11:17.502661 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484235    5640 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:11:17.502661 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.484238    5640 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:11:17.502661 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.488962    5640 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 04 01:11:17.502661 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.489008    5640 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 04 01:11:17.502661 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.489033    5640 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 04 01:11:17.502661 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.489041    5640 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 04 01:11:17.502661 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489129    5640 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:11:17.502661 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489139    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:11:17.502661 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489144    5640 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:11:17.502661 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489149    5640 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:11:17.502661 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489153    5640 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:11:17.502661 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489157    5640 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:11:17.502661 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489161    5640 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:11:17.503145 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489166    5640 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:11:17.503145 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489170    5640 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:11:17.503145 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489175    5640 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:11:17.503145 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489179    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:11:17.503145 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489184    5640 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:11:17.503145 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489189    5640 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:11:17.503145 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489194    5640 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:11:17.503145 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489199    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:11:17.503145 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489203    5640 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:11:17.503145 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489208    5640 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:11:17.503145 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489212    5640 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:11:17.503145 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489216    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:11:17.503145 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489221    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:11:17.503145 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489225    5640 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:11:17.503145 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489230    5640 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:11:17.503145 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489234    5640 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:11:17.503145 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489239    5640 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:11:17.503145 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489243    5640 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:11:17.503145 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489248    5640 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:11:17.503145 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489252    5640 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:11:17.503660 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489257    5640 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:11:17.503660 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489261    5640 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:11:17.503660 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489265    5640 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:11:17.503660 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489270    5640 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:11:17.503660 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489274    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:11:17.503660 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489278    5640 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:11:17.503660 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489283    5640 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:11:17.503660 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489287    5640 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:11:17.503660 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489292    5640 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:11:17.503660 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489296    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:11:17.503660 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489303    5640 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:11:17.503660 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489309    5640 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:11:17.503660 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489313    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:11:17.503660 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489319    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:11:17.503660 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489323    5640 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:11:17.503660 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489328    5640 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:11:17.503660 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489332    5640 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:11:17.503660 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489336    5640 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:11:17.503660 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489342    5640 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:11:17.504214 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489347    5640 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:11:17.504214 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489351    5640 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:11:17.504214 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489356    5640 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:11:17.504214 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489360    5640 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:11:17.504214 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489365    5640 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:11:17.504214 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489369    5640 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:11:17.504214 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489374    5640 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:11:17.504214 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489379    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:11:17.504214 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489384    5640 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:11:17.504214 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489388    5640 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:11:17.504214 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489392    5640 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:11:17.504214 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489397    5640 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:11:17.504214 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489401    5640 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:11:17.504214 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489406    5640 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:11:17.504214 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489410    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:11:17.504214 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489414    5640 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:11:17.504214 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489419    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:11:17.504214 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489424    5640 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:11:17.504214 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489428    5640 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:11:17.504214 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489432    5640 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:11:17.504687 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489436    5640 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:11:17.504687 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489441    5640 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:11:17.504687 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489445    5640 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:11:17.504687 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489450    5640 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:11:17.504687 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489454    5640 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:11:17.504687 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489459    5640 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:11:17.504687 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489463    5640 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:11:17.504687 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489467    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:11:17.504687 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489471    5640 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:11:17.504687 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489476    5640 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:11:17.504687 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489480    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:11:17.504687 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489484    5640 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:11:17.504687 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489493    5640 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:11:17.504687 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489502    5640 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:11:17.504687 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489507    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:11:17.504687 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489512    5640 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:11:17.504687 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489516    5640 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:11:17.504687 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489520    5640 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:11:17.504687 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489525    5640 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:11:17.505177 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489530    5640 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:11:17.505177 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489535    5640 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:11:17.505177 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489539    5640 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:11:17.505177 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489543    5640 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:11:17.505177 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489548    5640 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:11:17.505177 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489552    5640 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:11:17.505177 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489557    5640 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:11:17.505177 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489561    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:11:17.505177 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489566    5640 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:11:17.505177 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489570    5640 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:11:17.505177 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489574    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:11:17.505177 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489579    5640 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:11:17.505177 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489584    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:11:17.505177 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489588    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:11:17.505177 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489592    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:11:17.505177 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489596    5640 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:11:17.505177 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489601    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:11:17.505177 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489605    5640 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:11:17.505177 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489609    5640 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:11:17.505177 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489613    5640 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:11:17.505654 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489618    5640 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:11:17.505654 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.489658    5640 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 01:11:17.505654 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489884    5640 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:11:17.505654 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489892    5640 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:11:17.505654 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489896    5640 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:11:17.505654 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489903    5640 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:11:17.505654 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489911    5640 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:11:17.505654 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489916    5640 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:11:17.505654 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489922    5640 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:11:17.505654 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489927    5640 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:11:17.505654 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489932    5640 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:11:17.505654 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489936    5640 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:11:17.505654 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489941    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:11:17.505654 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489946    5640 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:11:17.505654 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489950    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:11:17.505654 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489954    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:11:17.506049 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489959    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:11:17.506049 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489980    5640 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:11:17.506049 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489985    5640 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:11:17.506049 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489990    5640 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:11:17.506049 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489994    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:11:17.506049 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.489999    5640 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:11:17.506049 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490003    5640 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:11:17.506049 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490007    5640 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:11:17.506049 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490011    5640 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:11:17.506049 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490016    5640 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:11:17.506049 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490020    5640 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:11:17.506049 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490024    5640 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:11:17.506049 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490029    5640 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:11:17.506049 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490033    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:11:17.506049 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490038    5640 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:11:17.506049 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490042    5640 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:11:17.506049 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490047    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:11:17.506049 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490051    5640 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:11:17.506049 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490055    5640 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:11:17.506049 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490059    5640 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:11:17.506540 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490064    5640 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:11:17.506540 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490069    5640 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:11:17.506540 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490073    5640 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:11:17.506540 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490078    5640 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:11:17.506540 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490083    5640 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:11:17.506540 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490088    5640 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:11:17.506540 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490092    5640 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:11:17.506540 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490097    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:11:17.506540 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490102    5640 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:11:17.506540 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490106    5640 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:11:17.506540 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490111    5640 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:11:17.506540 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490115    5640 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:11:17.506540 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490119    5640 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:11:17.506540 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490123    5640 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:11:17.506540 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490128    5640 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:11:17.506540 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490132    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:11:17.506540 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490136    5640 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:11:17.506540 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490140    5640 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:11:17.506540 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490147    5640 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:11:17.507122 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490154    5640 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:11:17.507122 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490159    5640 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:11:17.507122 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490164    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:11:17.507122 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490168    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:11:17.507122 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490173    5640 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:11:17.507122 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490177    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:11:17.507122 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490181    5640 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:11:17.507122 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490185    5640 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:11:17.507122 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490190    5640 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:11:17.507122 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490194    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:11:17.507122 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490199    5640 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:11:17.507122 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490203    5640 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:11:17.507122 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490207    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:11:17.507122 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490212    5640 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:11:17.507122 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490216    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:11:17.507122 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490220    5640 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:11:17.507122 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490224    5640 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:11:17.507122 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490229    5640 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:11:17.507122 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490234    5640 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:11:17.507122 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490238    5640 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:11:17.507778 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490243    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:11:17.507778 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490247    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:11:17.507778 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490251    5640 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:11:17.507778 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490255    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:11:17.507778 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490259    5640 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:11:17.507778 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490264    5640 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:11:17.507778 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490268    5640 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:11:17.507778 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490272    5640 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:11:17.507778 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490277    5640 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:11:17.507778 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490281    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:11:17.507778 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490285    5640 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:11:17.507778 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490290    5640 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:11:17.507778 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490294    5640 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:11:17.507778 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490299    5640 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:11:17.507778 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490303    5640 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:11:17.507778 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490307    5640 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:11:17.507778 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490312    5640 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:11:17.507778 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490316    5640 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:11:17.507778 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490320    5640 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:11:17.508417 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490325    5640 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:11:17.508417 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490329    5640 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:11:17.508417 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490333    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:11:17.508417 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490337    5640 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:11:17.508417 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490342    5640 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:11:17.508417 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490346    5640 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:11:17.508417 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490351    5640 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:11:17.508417 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490355    5640 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:11:17.508417 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490359    5640 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:11:17.508417 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490364    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:11:17.508417 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490368    5640 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:11:17.508417 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490373    5640 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:11:17.508417 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490378    5640 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:11:17.508417 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490382    5640 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:11:17.508417 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.490421    5640 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 01:11:17.508417 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490482    5640 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:11:17.509129 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490489    5640 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:11:17.509129 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490494    5640 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:11:17.509129 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490501    5640 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:11:17.509129 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490507    5640 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:11:17.509129 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490512    5640 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:11:17.509129 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490516    5640 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:11:17.509129 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490521    5640 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:11:17.509129 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490525    5640 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:11:17.509129 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490529    5640 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:11:17.509129 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490534    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:11:17.509129 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490539    5640 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:11:17.509129 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490544    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:11:17.509129 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490548    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:11:17.509129 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490553    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:11:17.509129 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490557    5640 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:11:17.509129 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490562    5640 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:11:17.509129 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490566    5640 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:11:17.509129 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490570    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:11:17.509129 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490574    5640 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:11:17.509129 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490578    5640 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:11:17.509852 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490582    5640 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:11:17.509852 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490587    5640 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:11:17.509852 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490591    5640 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:11:17.509852 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490595    5640 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:11:17.509852 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490599    5640 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:11:17.509852 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490604    5640 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:11:17.509852 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490608    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:11:17.509852 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490612    5640 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:11:17.509852 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490618    5640 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:11:17.509852 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490622    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:11:17.509852 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490627    5640 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:11:17.509852 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490633    5640 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:11:17.509852 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490637    5640 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:11:17.509852 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490641    5640 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:11:17.509852 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490645    5640 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:11:17.509852 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490650    5640 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:11:17.509852 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490654    5640 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:11:17.509852 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490658    5640 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:11:17.509852 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490663    5640 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:11:17.509852 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490667    5640 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:11:17.510544 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490671    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:11:17.510544 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490676    5640 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:11:17.510544 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490680    5640 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:11:17.510544 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490685    5640 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:11:17.510544 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490689    5640 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:11:17.510544 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490694    5640 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:11:17.510544 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490698    5640 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:11:17.510544 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490702    5640 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:11:17.510544 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490706    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:11:17.510544 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490710    5640 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:11:17.510544 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490715    5640 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:11:17.510544 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490721    5640 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:11:17.510544 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490727    5640 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:11:17.510544 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490732    5640 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:11:17.510544 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490736    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:11:17.510544 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490741    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:11:17.510544 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490745    5640 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:11:17.510544 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490749    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:11:17.510544 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490761    5640 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:11:17.511058 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490765    5640 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:11:17.511058 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490770    5640 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:11:17.511058 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490778    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:11:17.511058 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490783    5640 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:11:17.511058 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490788    5640 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:11:17.511058 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490792    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:11:17.511058 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490796    5640 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:11:17.511058 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490800    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:11:17.511058 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490804    5640 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:11:17.511058 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490809    5640 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:11:17.511058 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490813    5640 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:11:17.511058 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490817    5640 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:11:17.511058 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490821    5640 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:11:17.511058 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490826    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:11:17.511058 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490830    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:11:17.511058 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490835    5640 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:11:17.511058 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490840    5640 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:11:17.511058 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490844    5640 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:11:17.511058 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490849    5640 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:11:17.511563 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490853    5640 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:11:17.511563 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490858    5640 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:11:17.511563 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490862    5640 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:11:17.511563 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490866    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:11:17.511563 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490871    5640 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:11:17.511563 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490875    5640 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:11:17.511563 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490879    5640 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:11:17.511563 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490883    5640 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:11:17.511563 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490888    5640 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:11:17.511563 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490892    5640 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:11:17.511563 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490896    5640 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:11:17.511563 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490901    5640 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:11:17.511563 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490906    5640 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:11:17.511563 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490910    5640 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:11:17.511563 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490915    5640 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:11:17.511563 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490920    5640 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:11:17.511563 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490925    5640 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:11:17.511563 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490930    5640 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:11:17.511563 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490934    5640 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:11:17.512168 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490940    5640 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:11:17.512168 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490944    5640 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:11:17.512168 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490949    5640 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:11:17.512168 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490953    5640 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:11:17.512168 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490957    5640 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:11:17.512168 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490961    5640 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:11:17.512168 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490980    5640 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:11:17.512168 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:17.490984    5640 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:11:17.512168 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.491067    5640 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 04 01:11:17.512168 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.492629    5640 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Nov 04 01:11:17.512168 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.492714    5640 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Nov 04 01:11:17.512168 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.492995    5640 server.go:1014] "Starting client certificate rotation"
Nov 04 01:11:17.512168 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.493089    5640 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 01:11:17.512168 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.493131    5640 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 01:05:05 +0000 UTC" deadline="2028-04-15 11:09:46.805323728 +0000 UTC"
Nov 04 01:11:17.512168 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.493158    5640 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12681h58m29.312167045s"
Nov 04 01:11:17.512168 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.493803    5640 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 01:11:17.512639 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.496841    5640 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 01:11:17.512639 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.498372    5640 log.go:25] "Validated CRI v1 runtime API"
Nov 04 01:11:17.512639 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.500270    5640 log.go:25] "Validated CRI v1 image API"
Nov 04 01:11:17.512639 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.501103    5640 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 04 01:11:17.512639 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.503249    5640 fs.go:135] Filesystem UUIDs: map[63eddd5d-72a2-40e9-8274-8816d2d8331b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ecda85b3-ab5c-4a67-9088-dc4a5fa6822c:/dev/nvme0n1p3]
Nov 04 01:11:17.512958 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.503269    5640 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0f15bf153451982e313c62a87824c6186713b92eef5c1d95cefe8eb8ead95213/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0f15bf153451982e313c62a87824c6186713b92eef5c1d95cefe8eb8ead95213/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/203705501eeff81f21d76b1b64495010efe192f9a39fd9e2a09eb720be6eb994/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/203705501eeff81f21d76b1b64495010efe192f9a39fd9e2a09eb720be6eb994/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2087462528cfd72c74c36f4d1b132326b44d3906b2a83b7cb8d1ca4a61ef1dd2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2087462528cfd72c74c36f4d1b132326b44d3906b2a83b7cb8d1ca4a61ef1dd2/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/34186d5a792d0c8e062544d6dccaac193464a72068403d3e05829ccc46ec802c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/34186d5a792d0c8e062544d6dccaac193464a72068403d3e05829ccc46ec802c/userdata/shm major:0 minor:415 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3afc624431f8a97662a03146dedd3d5bf1a2e4366d630feac4c31e8595446ef2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3afc624431f8a97662a03146dedd3d5bf1a2e4366d630feac4c31e8595446ef2/userdata/shm major:0 minor:307 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/595f7603f5f2fe03f14228d78dc5a53c997b3d6b190092a9e5c8c725e0cf375e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/595f7603f5f2fe03f14228d78dc5a53c997b3d6b190092a9e5c8c725e0cf375e/userdata/shm major:0 minor:261 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7164a2072ebbc5206a8613c13bc1bbc7230f1843ebbceff03f1d177e776a66c2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7164a2072ebbc5206a8613c13bc1bbc7230f1843ebbceff03f1d177e776a66c2/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7687c626b27a4f2a5ac248780f34f95a551c2a479d8636a2e0452d365276a21f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7687c626b27a4f2a5ac248780f34f95a551c2a479d8636a2e0452d365276a21f/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7981587290d1c0f49e91c27e574f7842c514ef89376ab3235318bc7485da4356/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7981587290d1c0f49e91c27e574f7842c514ef89376ab3235318bc7485da4356/userdata/shm major:0 minor:414 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/96f7b920c99e1d236fafc58eb209c6b6020848d762518d5752e2729ce671b7c3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/96f7b920c99e1d236fafc58eb209c6b6020848d762518d5752e2729ce671b7c3/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9707c16bb6a9c0396db9741abfe71eee71aedc4f00016666a8bf7e75832b17b6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9707c16bb6a9c0396db9741abfe71eee71aedc4f00016666a8bf7e75832b17b6/userdata/shm major:0 minor:388 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9f6c128be7cfaf7336c3e55c967b569835f1aff4e12f33ced41953dc6d55fe94/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9f6c128be7cfaf7336c3e55c967b569835f1aff4e12f33ced41953dc6d55fe94/userdata/shm major:0 minor:265 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/abdee1768829bac6ec5dd61ff0d0a0b8fbb57c6e96ec61f407b4e1201295daa0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/abdee1768829bac6ec5dd61ff0d0a0b8fbb57c6e96ec61f407b4e1201295daa0/userdata/shm major:0 minor:285 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ad22e71cff5ad7843215a4d818d74404e5a6a5a3ad3d5ff31e231382eefb9d66/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ad22e71cff5ad7843215a4d818d74404e5a6a5a3ad3d5ff31e231382eefb9d66/userdata/shm major:0 minor:418 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b37230d2516bdf52e266bef05d202602417fd93cb7881baeac3234c87afe7741/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b37230d2516bdf52e266bef05d202602417fd93cb7881baeac3234c87afe7741/userdata/shm major:0 minor:51 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c5e29cbdf14d41b458afd33c96d760f5b7e1c9109ba069496ad35edc383f3cd6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c5e29cbdf14d41b458afd33c96d760f5b7e1c9109ba069496ad35edc383f3cd6/userdata/shm major:0 minor:401 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/caa3d106e523f500050b2ce2c243d91398b475c5456130fd52d6b07324c37371/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/caa3d106e523f500050b2ce2c243d91398b475c5456130fd52d6b07324c37371/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d2f664120424156696457e59ea652f199d7f932e788d92e24b7e15254bdd53c2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d2f664120424156696457e59ea652f199d7f932e788d92e24b7e15254bdd53c2/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d5b71c5c77a5dbada7375109bd6643a3c6252aa57d74481478287246e3dd79c9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d5b71c5c77a5dbada7375109bd6643a3c6252aa57d74481478287246e3dd79c9/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e38053e13fa5856c155196fce59ca2714040fd1dbfb4cb45f3da171a8add1be5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e38053e13fa5856c155196fce59ca2714040fd1dbfb4cb45f3da171a8add1be5/userdata/shm major:0 minor:338 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/eabae22ffdb87e7fe5d5dc202a254bbc8df37804387113d66bfedc8de72f9684/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/eabae22ffdb87e7fe5d5dc202a254bbc8df37804387113d66bfedc8de72f9684/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f7d07647e9578409e683b2ffde035906843e842b6509af0778162e73571ce3d9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f7d07647e9578409e683b2ffde035906843e842b6509af0778162e73571ce3d9/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f81899f315147c07b4a2b2f46caca257a4417420ff3edf8f5752707681e79594/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f81899f315147c07b4a2b2f46caca257a4417420ff3edf8f5752707681e79594/userdata/shm major:0 minor:257 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f8500f73262b59eddca75f848b70f2d3b83021145163058960b0dc0ba07736a7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f8500f73262b59eddca75f848b70f2d3b83021145163058960b0dc0ba07736a7/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/081d2b6e-a762-4015-8a75-a43b0f6c9e66/volumes/kubernetes.io~projected/kube-api-access-5r69h:{mountpoint:/var/lib/kubelet/pods/081d2b6e-a762-4015-8a75-a43b0f6c9e66/volumes/kubernetes.io~projected/kube-api-access-5r69h major:0 minor:249 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/081d2b6e-a762-4015-8a75-a43b0f6c9e66/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/081d2b6e-a762-4015-8a75-a43b0f6c9e66/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:241 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/081d2b6e-a762-4015-8a75-a43b0f6c9e66/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/081d2b6e-a762-4015-8a75-a43b0f6c9e66/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:246 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/09213485-c715-420e-ab7d-c6cc3ee149a5/volumes/kubernetes.io~projected/kube-api-access-2chjr:{mountpoint:/var/lib/kubelet/pods/09213485-c715-420e-ab7d-c6cc3ee149a5/volumes/kubernetes.io~projected/kube-api-access-2chjr major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1f23f719-7430-4b54-9204-13d0c5bebf96/volumes/kubernetes.io~projected/kube-api-access-ckw42:{mountpoint:/var/lib/kubelet/pods/1f23f719-7430-4b54-9204-13d0c5bebf96/volumes/kubernetes.io~projected/kube-api-access-ckw42 major:0 minor:259 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1f23f719-7430-4b54-9204-13d0c5bebf96/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/1f23f719-7430-4b54-9204-13d0c5bebf96/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:256 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1f23f719-7430-4b54-9204-13d0c5bebf96/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/1f23f719-7430-4b54-9204-13d0c5bebf96/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:255 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26e3ee34-ace5-4eda-a96a-6c0014a989ee/volumes/kubernetes.io~projected/kube-api-access-8bm95:{mountpoint:/var/lib/kubelet/pods/26e3ee34-ace5-4eda-a96a-6c0014a989ee/volumes/kubernetes.io~projected/kube-api-access-8bm95 major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26e3ee34-ace5-4eda-a96a-6c0014a989ee/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/26e3ee34-ace5-4eda-a96a-6c0014a989ee/volumes/kubernetes.io~secret/cert major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2db16eff-7518-4f50-b080-8208d5e756cc/volumes/kubernetes.io~projected/kube-api-access-56tjz:{mountpoint:/var/lib/kubelet/pods/2db16eff-7518-4f50-b080-8208d5e756cc/volumes/kubernetes.io~projected/kube-api-access-56tjz major:0 minor:413 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/39732b86-9f58-44ea-925e-a5e45c676586/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/39732b86-9f58-44ea-925e-a5e45c676586/volumes/kubernetes.io~secret/agent-certs major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/39954ddf-ace6-4e62-a9b4-5d12a77b202c/volumes/kubernetes.io~projected/kube-api-access-5lp9w:{mountpoint:/var/lib/kubelet/pods/39954ddf-ace6-4e62-a9b4-5d12a77b202c/volumes/kubernetes.io~projected/kube-api-access-5lp9w major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/39954ddf-ace6-4e62-a9b4-5d12a77b202c/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/39954ddf-ace6-4e62-a9b4-5d12a77b202c/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3f67bd09-93fb-4738-b800-36b41330d329/volumes/kubernetes.io~projected/kube-api-access-r8gn5:{mountpoint:/var/lib/kubelet/pods/3f67bd09-93fb-4738-b800-36b41330d329/volumes/kubernetes.io~projected/kube-api-access-r8gn5 major:0 minor:284 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3f67bd09-93fb-4738-b800-36b41330d329/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/3f67bd09-93fb-4738-b800-36b41330d329/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:283 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3f67bd09-93fb-4738-b800-36b41330d329/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/3f67bd09-93fb-4738-b800-36b41330d329/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:282 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/42e12e95-3cc8-4393-93fb-087e19f92874/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/42e12e95-3cc8-4393-93fb-087e19f92874/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:412 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2/volumes/kubernetes.io~projected/kube-api-access-tjg74:{mountpoint:/var/lib/kubelet/pods/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2/volumes/kubernetes.io~projected/kube-api-access-tjg74 major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea/volumes/kubernetes.io~projected/kube-api-access-hxgrv:{mountpoint:/var/lib/kubelet/pods/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea/volumes/kubernetes.io~projected/kube-api-access-hxgrv major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea/volumes/kubernetes.io~secret/metrics-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:294 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volume-subpaths/web-config/alertmanager/9 major:0 minor:290 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volume-subpaths/web-config/config-reloader/6 major:0 minor:290 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:290 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~empty-dir/config-out major:0 minor:289 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~projected/kube-api-access-cjkw7:{mountpoint:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~projected/kube-api-access-cjkw7 major:0 minor:304 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~projected/tls-assets major:0 minor:297 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:294 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~secret/config-volume major:0 minor:292 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:296 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:291 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~secret/web-config major:0 minor:290 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4fc117ae-0111-4ce2-9676-f125a8b64be9/volumes/kubernetes.io~projected/kube-api-access-pt2dh:{mountpoint:/var/lib/kubelet/pods/4fc117ae-0111-4ce2-9676-f125a8b64be9/volumes/kubernetes.io~projected/kube-api-access-pt2dh major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/51c03abc-b77b-4b72-a707-293e13734fae/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/51c03abc-b77b-4b72-a707-293e13734fae/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/51c03abc-b77b-4b72-a707-293e13734fae/volumes/kubernetes.io~projected/kube-api-access-lqj94:{mountpoint:/var/lib/kubelet/pods/51c03abc-b77b-4b72-a707-293e13734fae/volumes/kubernetes.io~projected/kube-api-access-lqj94 major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/51c03abc-b77b-4b72-a707-293e13734fae/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/51c03abc-b77b-4b72-a707-293e13734fae/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe/volumes/kubernetes.io~projected/kube-api-access-dtpwr:{mountpoint:/var/lib/kubelet/pods/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe/volumes/kubernetes.io~projected/kube-api-access-dtpwr major:0 minor:337 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:331 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:335 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:336 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7af658ed-1cc4-4f7d-b9c8-c0437180bb43/volumes/kubernetes.io~projected/kube-api-access-lxqmf:{mountpoint:/var/lib/kubelet/pods/7af658ed-1cc4-4f7d-b9c8-c0437180bb43/volumes/kubernetes.io~projected/kube-api-access-lxqmf major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96855631-beca-4d91-814d-689668f6de56/volumes/kubernetes.io~projected/kube-api-access-sfl4s:{mountpoint:/var/lib/kubelet/pods/96855631-beca-4d91-814d-689668f6de56/volumes/kubernetes.io~projected/kube-api-access-sfl4s major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96855631-beca-4d91-814d-689668f6de56/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/96855631-beca-4d91-814d-689668f6de56/volumes/kubernetes.io~secret/metrics-certs major:0 minor:407 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9c5a2182-4c90-4ceb-b983-e7428f3a40be/volumes/kubernetes.io~projected/kube-api-access-nqhvd:{mountpoint:/var/lib/kubelet/pods/9c5a2182-4c90-4ceb-b983-e7428f3a40be/volumes/kubernetes.io~projected/kube-api-access-nqhvd major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b12672cc-5caf-4cce-90b1-babce76c4007/volumes/kubernetes.io~projected/kube-api-access-kbs8l:{mountpoint:/var/lib/kubelet/pods/b12672cc-5caf-4cce-90b1-babce76c4007/volumes/kubernetes.io~projected/kube-api-access-kbs8l major:0 minor:400 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b12672cc-5caf-4cce-90b1-babce76c4007/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/b12672cc-5caf-4cce-90b1-babce76c4007/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:399 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b12672cc-5caf-4cce-90b1-babce76c4007/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/b12672cc-5caf-4cce-90b1-babce76c4007/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:394 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c242f2eb-7d62-4990-84b0-04175eefc461/volumes/kubernetes.io~projected/kube-api-access-wpqvm:{mountpoint:/var/lib/kubelet/pods/c242f2eb-7d62-4990-84b0-04175eefc461/volumes/kubernetes.io~projected/kube-api-access-wpqvm major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cf440cad-3487-46a5-9d2d-4badf508cbe1/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/cf440cad-3487-46a5-9d2d-4badf508cbe1/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cf440cad-3487-46a5-9d2d-4badf508cbe1/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/cf440cad-3487-46a5-9d2d-4badf508cbe1/volumes/kubernetes.io~empty-dir/tmp major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cf440cad-3487-46a5-9d2d-4badf508cbe1/volumes/kubernetes.io~projected/kube-api-access-nm54c:{mountpoint:/var/lib/kubelet/pods/cf440cad-3487-46a5-9d2d-4badf508cbe1/volumes/kubernetes.io~projected/kube-api-access-nm54c major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d6cefe39-1545-44f8-a04c-d2dc001be4a4/volumes/kubernetes.io~projected/kube-api-access-gp4rk:{mountpoint:/var/lib/kubelet/pods/d6cefe39-1545-44f8-a04c-d2dc001be4a4/volumes/kubernetes.io~projected/kube-api-access-gp4rk major:0 minor:387 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d6cefe39-1545-44f8-a04c-d2dc001be4a4/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/d6cefe39-1545-44f8-a04c-d2dc001be4a4/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:382 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d6cefe39-1545-44f8-a04c-d2dc001be4a4/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/d6cefe39-1545-44f8-a04c-d2dc001be4a4/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:386 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/db2a554a-660a-4b82-8e0e-70eaac7d1136/volumes/kubernetes.io~projected/kube-api-access-j4kv5:{mountpoint:/var/lib/kubelet/pods/db2a554a-660a-4b82-8e0e-70eaac7d1136/volumes/kubernetes.io~projected/kube-api-access-j4kv5 major:0 minor:260 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/db2a554a-660a-4b82-8e0e-70eaac7d1136/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/db2a554a-660a-4b82-8e0e-70eaac7d1136/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:250 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/db2a554a-660a-4b82-8e0e-70eaac7d1136/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/db2a554a-660a-4b82-8e0e-70eaac7d1136/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:254 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/0448d7f36416f0a0a088836fec45c1f3aecc1494af532e79c126ba14076c2324/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/ec850ba69b7b13d90f11c9ae4c7e916659508ad512f1a5db682762514860c18b/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/bae3a38b8bd8477d971d0c96c1770ec74ece8746fb6d2bd086b7a3b170a4cacb/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/0ab1af510b54c659996865ca3e3bd85dd519c3d5befafd7609de90e3ea086338/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/1a166a08047e08ea83aa5b2833783278cb731b7bfe854a8eb18932fc93772983/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/2d0771431a6c9d2b7ac552fbe37aea3577fe5623afb88d462ba43deeffdbca44/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/f3c68fdc24f0eddb8f33c104a77097f7798758a635c6cde0a53969baf1a9e513/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/4260d57c35f952c52bae04d54b843433d6cc54fd52ebb22e57d9cac0a0bda4ef/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/38cba9504c579c40e90872ee578e8781162e41f2d5ecefc48006440551ee73f5/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/06ad815e96371eac0063831550e2f67156b76c5510e9c31ec1445917484d11b7/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/484454b335d65a311c0100e93c080266d3dc881a1679234e9d2e3b609c19af8a/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-147:{mountpoint:/var/lib/containers/storage/overlay/c25a0a3711fb3acc363471b8d6812498d06dffcce0a6a5b4616f6337fdbd142d/merged major:0 minor:147 fsType:overlay blockSize:0} overlay_0-149:{mountpoint:/var/lib/containers/storage/overlay/bacf71902be4614e0ae4dc5a77ce572fff362f30135851212499d2cd2e07a656/merged major:0 minor:149 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/7168dfe148de11a6a351bc773ed9bc07c27174b457e94f12294606a78216a11d/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/51ec786bd223c959dc2c30ab2981a14e1a7806384622f7289b24f746f7087490/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/06f74aeb5633c3314612fc9044e3ed14c46548c8ddd28c94e05799db071e0e38/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/ed97c113a414e07c0da4958375d53cae6498cf51e8c307b41b4b49cb949c3013/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/6704a7e3efa842b8ee4074703f08e6689b685de77c133590adccc2a1d4f91e78/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-179:{mountpoint:/var/lib/containers/storage/overlay/64434f87d8b0407365fede78f1b2f03a6f044af7116c38b4b69c8f7ef8a284bf/merged major:0 minor:179 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/4507f8649854334b27a42adbb2f951e1bd3282902096cce6927ae91d295ad0df/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/71886069d6bd9bf661482806522762b6384daca73c5441da5c7cc06e61eee03b/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/9181bdb83fddbdeda2e5f52a7a7e3d23f111a145f04f157af94556c8de48ee9a/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/4fd456816495e2bec832952d0a9af083d591eac0fa4232ab7a67bac9e813c11e/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/3a8bfc239839ff542ff34ab464ac5de97afb20234c02433dfe3b684fe33963e7/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/030b9603b25825d74c29306d81d465ae33fcb2098026fe934526da3b6618b448/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-219:{mountpoint:/var/lib/containers/storage/overlay/c73694cf86b423c28c51c1478785cc2e72b45b6e33a99a9be2ea659bf4a65115/merged major:0 minor:219 fsType:overlay blockSize:0} overlay_0-225:{mountpoint:/var/lib/containers/storage/overlay/8cbc585cf48e9030cf479ca7fa5142ba4464f48e80042799bb3b36acf8878bf8/merged major:0 minor:225 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/a664a4647337bd53345a047b6a1f0acecd793f243201bac0e1d0ea382608d132/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-236:{mountpoint:/var/lib/containers/storage/overlay/974b989b4fe8aa0ce59a50e7498ba87310056c9331e219ce25b9603bd359d7fb/merged major:0 minor:236 fsType:overlay blockSize:0} overlay_0-247:{mountpoint:/var/lib/containers/storage/overlay/16148b2a1d42eda567723caa4ec9e5d4901b7c92bc026bf1fc748bd9a3349e98/merged major:0 minor:247 fsType:overlay blockSize:0} overlay_0-263:{mountpoint:/var/lib/containers/storage/overlay/2d93fd56137cf4d12a3243fee4002c389da1d9eb084ba8ae297c4af96a2c1901/merged major:0 minor:263 fsType:overlay blockSize:0} overlay_0-267:{mountpoint:/var/lib/containers/storage/overlay/5b337a09871f13d5fadc79620ce617df9d3cc1109499fbd093da2500e2e69f1c/merged major:0 minor:267 fsType:overlay blockSize:0} overlay_0-269:{mountpoint:/var/lib/containers/storage/overlay/5de2f88f939246d793e2e6cb7752a788065b4ce84bf67bd314e2d8bb37319e48/merged major:0 minor:269 fsType:overlay blockSize:0} overlay_0-271:{mountpoint:/var/lib/containers/storage/overlay/fca839386b395bf3b420cc808b2f36a1e34998f88c59bdab27aaa313659c9324/merged major:0 minor:271 fsType:overlay blockSize:0} overlay_0-277:{mountpoint:/var/lib/containers/storage/overlay/ba849df70810305f9de3f5ff711e2a79bda592e390db45a94edc099bb54fd6d8/merged major:0 minor:277 fsType:overlay blockSize:0} overlay_0-287:{mountpoint:/var/lib/containers/storage/overlay/026e25cdea06ddecd80f4d160a134ce7236304662de03817a97936b0cdc665ef/merged major:0 minor:287 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/585107d152388cace9d731d68d2f57fb469b564a73ed09f58cabe71b55054ca5/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/c3d86fe6d61a19aa8dc974a22af62d8c83d98fad8ebb0a9e07cc82f6a0bff353/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-306:{mountpoint:/var/lib/containers/storage/overlay/6c3c2148ed7b4aa599c3dbcb8034e9beaadd156037a6a31b3b9edae6be26109d/merged major:0 minor:306 fsType:overlay blockSize:0} overlay_0-314:{mountpoint:/var/lib/containers/storage/overlay/4853c056ec92fbd7ef9bdcf25fabb755a77683fb02b3ff46f7f9f7c68f585831/merged major:0 minor:314 fsType:overlay blockSize:0} overlay_0-319:{mountpoint:/var/lib/containers/storage/overlay/21549eb4baf933a1d21deb71c6964a8520570f65c52773ae1c672b754bf72388/merged major:0 minor:319 fsType:overlay blockSize:0} overlay_0-324:{mountpoint:/var/lib/containers/storage/overlay/4309c9aa24eb461433b8e21b63999ad2ad7d6dfdc0b2558931d1efdeec5f7fb6/merged major:0 minor:324 fsType:overlay blockSize:0} overlay_0-329:{mountpoint:/var/lib/containers/storage/overlay/189245be90886411c858c8eac7cd3834dda5058b9ba6155748de6a08f8b167a2/merged major:0 minor:329 fsType:overlay blockSize:0} overlay_0-340:{mountpoint:/var/lib/containers/storage/overlay/e9f0bd21a8ee9c852edc54aca5cd8f237efec9d88ebeb7e57c3081ea87cba64e/merged major:0 minor:340 fsType:overlay blockSize:0} overlay_0-342:{mountpoint:/var/lib/containers/storage/overlay/53a4098af9bd0718f76f64638a3ee67fa02e63266b68ce68ff2b3052243e6e15/merged major:0 minor:342 fsType:overlay blockSize:0} overlay_0-348:{mountpoint:/var/lib/containers/storage/overlay/dd198087b757898d425f448d5eb7dbba335293efa4ad678521911907e181bdd7/merged major:0 minor:348 fsType:overlay blockSize:0} overlay_0-350:{mountpoint:/var/lib/containers/storage/overlay/2ab346e67d88acd415c8b275240e11a4f56b823411f30ae8ef296ba2dc62a526/merged major:0 minor:350 fsType:overlay blockSize:0} overlay_0-356:{mountpoint:/var/lib/containers/storage/overlay/81b951890651003032072bd9675885168e44aabe8a1d973fc89a5591269f1adf/merged major:0 minor:356 fsType:overlay blockSize:0} overlay_0-362:{mountpoint:/var/lib/containers/storage/overlay/50ee4543d94c9d32db6362a6d48449ddbbf55872189859f556ea9e4a7af86c14/merged major:0 minor:362 fsType:overlay blockSize:0} overlay_0-367:{mountpoint:/var/lib/containers/storage/overlay/c81ace0d0e98fb6ea9db9642ee064f6ca4f533e0954ddb0eaa9a2a0eabc7c4b1/merged major:0 minor:367 fsType:overlay blockSize:0} overlay_0-372:{mountpoint:/var/lib/containers/storage/overlay/0180c688e8e91fcdadf7ff8cc2767061b3610d448628d77e7517010627b7ed2b/merged major:0 minor:372 fsType:overlay blockSize:0} overlay_0-377:{mountpoint:/var/lib/containers/storage/overlay/d805995671234438f02ac65940f8215d14eaf80eb79d7227b7dda3213c515dba/merged major:0 minor:377 fsType:overlay blockSize:0} overlay_0-390:{mountpoint:/var/lib/containers/storage/overlay/4815ed57175ea9557e0b5c6cc0c4993b977d9aa7f496605bae549256aa05645b/merged major:0 minor:390 fsType:overlay blockSize:0} overlay_0-392:{mountpoint:/var/lib/containers/storage/overlay/147296782b810acc235860a55a420a9334da69d0992b7f2e56cfd08259f325f8/merged major:0 minor:392 fsType:overlay blockSize:0} overlay_0-403:{mountpoint:/var/lib/containers/storage/overlay/de1cedd8996ca0b327960d33b23c62cb571110209064d16f86546b95669bfe03/merged major:0 minor:403 fsType:overlay blockSize:0} overlay_0-405:{mountpoint:/var/lib/containers/storage/overlay/47e872690704427303eff65c095c700e743fd16294d15a5ed805fd4d3845da67/merged major:0 minor:405 fsType:overlay blockSize:0} overlay_0-420:{mountpoint:/var/lib/containers/storage/overlay/3ebeaf2c0edc242b4c220181e7fb704dbc2bd488d9ce69b34422618698b97cb4/merged major:0 minor:420 fsType:overlay blockSize:0} overlay_0-422:{mountpoint:/var/lib/containers/storage/overlay/e6126aacb1a21711731bf95b5a5bc78684033765dc36d65269d00ed7599be0db/merged major:0 minor:422 fsType:overlay blockSize:0} overlay_0-424:{mountpoint:/var/lib/containers/storage/overlay/566957ed06a80fbd537069eb40077c60bda25725caca4097704c49b379ff86ee/merged major:0 minor:424 fsType:overlay blockSize:0} overlay_0-426:{mountpoint:/var/lib/containers/storage/overlay/6360507c68b45eb73e9ca5d2b36cfb61c8dd1a1d9cbd138c3dac26e28b140ea5/merged major:0 minor:426 fsType:overlay blockSize:0} overlay_0-428:{mountpoint:/var/lib/containers/storage/overlay/db52948782820dddfb5991194898ee7ca8cd35e5cafe56600f900c919a00d8d7/merged major:0 minor:428 fsType:overlay blockSize:0} overlay_0-434:{mountpoint:/var/lib/containers/storage/overlay/28cf56426a25e64d2dd71d8bf5c9b5daaff910cc5c03263e9ff7f997cbf63eaa/merged major:0 minor:434 fsType:overlay blockSize:0} overlay_0-439:{mountpoint:/var/lib/containers/storage/overlay/2d647630753de63e9009c7347cf8ec59742dfda3cfe0eb995ffe9d5e1e509f22/merged major:0 minor:439 fsType:overlay blockSize:0} overlay_0-49:{mountpoint:/var/lib/containers/storage/overlay/215ea37e78d0116c418b324e94ef14c00a1d1ef3d9b9a1ae02b9dd0ef70d3eba/merged major:0 minor:49 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/eff41234184b6d5662fceafca9dbffa50b22a9286f58118c22cbad7b4eed3bcc/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/68663ed03430f5fd96531dffaf61f7843c9227f12503722b588b0d994a2686a4/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/451fa28d1735eddafe2425f81ffd00e6ff727c31eb4dee99a738e55fe4b68023/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/4b3ed17f34920e38947065e4205465be5534032c5002f6504808d7a6eeb31719/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/8d7aa1921dde41f566ffefa24a9dd68d059bdf5a1ec99cc6d7889a75becaf1e7/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/0a6b950938e825948d06dbee202372ce4a0214caa7dd8cbedf55eb69e6c059a9/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/f87fc2bce5bef178c0ea9792da08cae113ed19f85711552b7b62cae9d86ba400/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/08a6cc81bfac438e9f25f2cccd4a40d948729e6a0b2267148afb4ac30f6ae035/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/bcd454ab3d44521cc9d1ff61eda4bc9a077220c90c0d893fcf576b70283fb9b8/merged major:0 minor:96 fsType:overlay blockSize:0}]
Nov 04 01:11:17.513261 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.510831    5640 manager.go:217] Machine: {Timestamp:2026-11-04 01:11:17.510357411 +0000 UTC m=+0.062817529 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098552 MemoryCapacity:33164337152 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec279bf0c982f8bf5c44f9e96b4b6ca6 SystemUUID:ec279bf0-c982-f8bf-5c44-f9e96b4b6ca6 BootID:862db6b0-b2dc-4098-a58f-0c976163f770 Filesystems:[{Device:overlay_0-306 DeviceMajor:0 DeviceMinor:306 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-348 DeviceMajor:0 DeviceMinor:348 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/26e3ee34-ace5-4eda-a96a-6c0014a989ee/volumes/kubernetes.io~projected/kube-api-access-8bm95 DeviceMajor:0 DeviceMinor:201 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f81899f315147c07b4a2b2f46caca257a4417420ff3edf8f5752707681e79594/userdata/shm DeviceMajor:0 DeviceMinor:257 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b12672cc-5caf-4cce-90b1-babce76c4007/volumes/kubernetes.io~projected/kube-api-access-kbs8l DeviceMajor:0 DeviceMinor:400 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:291 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-319 DeviceMajor:0 DeviceMinor:319 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-324 DeviceMajor:0 DeviceMinor:324 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-434 DeviceMajor:0 DeviceMinor:434 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1f23f719-7430-4b54-9204-13d0c5bebf96/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:255 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-263 DeviceMajor:0 DeviceMinor:263 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:295 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1f23f719-7430-4b54-9204-13d0c5bebf96/volumes/kubernetes.io~projected/kube-api-access-ckw42 DeviceMajor:0 DeviceMinor:259 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-277 DeviceMajor:0 DeviceMinor:277 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-428 DeviceMajor:0 DeviceMinor:428 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-147 DeviceMajor:0 DeviceMinor:147 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1f23f719-7430-4b54-9204-13d0c5bebf96/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:256 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:293 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f8500f73262b59eddca75f848b70f2d3b83021145163058960b0dc0ba07736a7/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-271 DeviceMajor:0 DeviceMinor:271 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:331 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:336 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/2db16eff-7518-4f50-b080-8208d5e756cc/volumes/kubernetes.io~projected/kube-api-access-56tjz DeviceMajor:0 DeviceMinor:413 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/51c03abc-b77b-4b72-a707-293e13734fae/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:58 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/cf440cad-3487-46a5-9d2d-4badf508cbe1/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:60 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2087462528cfd72c74c36f4d1b132326b44d3906b2a83b7cb8d1ca4a61ef1dd2/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-329 DeviceMajor:0 DeviceMinor:329 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-367 DeviceMajor:0 DeviceMinor:367 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d6cefe39-1545-44f8-a04c-d2dc001be4a4/volumes/kubernetes.io~projected/kube-api-access-gp4rk DeviceMajor:0 DeviceMinor:387 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-390 DeviceMajor:0 DeviceMinor:390 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/39954ddf-ace6-4e62-a9b4-5d12a77b202c/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:203 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~projected/kube-api-access-cjkw7 DeviceMajor:0 DeviceMinor:304 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-350 DeviceMajor:0 DeviceMinor:350 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c5e29cbdf14d41b458afd33c96d760f5b7e1c9109ba069496ad35edc383f3cd6/userdata/shm DeviceMajor:0 DeviceMinor:401 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe/volumes/kubernetes.io~projected/kube-api-access-dtpwr DeviceMajor:0 DeviceMinor:337 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-372 DeviceMajor:0 DeviceMinor:372 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-439 DeviceMajor:0 DeviceMinor:439 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-287 DeviceMajor:0 DeviceMinor:287 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:297 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-179 DeviceMajor:0 DeviceMinor:179 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:45 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-267 DeviceMajor:0 DeviceMinor:267 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7981587290d1c0f49e91c27e574f7842c514ef89376ab3235318bc7485da4356/userdata/shm DeviceMajor:0 DeviceMinor:414 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/34186d5a792d0c8e062544d6dccaac193464a72068403d3e05829ccc46ec802c/userdata/shm DeviceMajor:0 DeviceMinor:415 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4fc117ae-0111-4ce2-9676-f125a8b64be9/volumes/kubernetes.io~projected/kube-api-access-pt2dh DeviceMajor:0 DeviceMinor:65 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-247 DeviceMajor:0 DeviceMinor:247 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3f67bd09-93fb-4738-b800-36b41330d329/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:282 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/42e12e95-3cc8-4393-93fb-087e19f92874/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:412 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d2f664120424156696457e59ea652f199d7f932e788d92e24b7e15254bdd53c2/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/081d2b6e-a762-4015-8a75-a43b0f6c9e66/volumes/kubernetes.io~projected/kube-api-access-5r69h DeviceMajor:0 DeviceMinor:249 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:290 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/081d2b6e-a762-4015-8a75-a43b0f6c9e66/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:241 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:335 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-392 DeviceMajor:0 DeviceMinor:392 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-424 DeviceMajor:0 DeviceMinor:424 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/caa3d106e523f500050b2ce2c243d91398b475c5456130fd52d6b07324c37371/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/39732b86-9f58-44ea-925e-a5e45c676586/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:55 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-149 DeviceMajor:0 DeviceMinor:149 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-269 DeviceMajor:0 DeviceMinor:269 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-219 DeviceMajor:0 DeviceMinor:219 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-342 DeviceMajor:0 DeviceMinor:342 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b12672cc-5caf-4cce-90b1-babce76c4007/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:394 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-236 DeviceMajor:0 DeviceMinor:236 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/abdee1768829bac6ec5dd61ff0d0a0b8fbb57c6e96ec61f407b4e1201295daa0/userdata/shm DeviceMajor:0 DeviceMinor:285 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d6cefe39-1545-44f8-a04c-d2dc001be4a4/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:386 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-403 DeviceMajor:0 DeviceMinor:403 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-420 DeviceMajor:0 DeviceMinor:420 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2/volumes/kubernetes.io~projected/kube-api-access-tjg74 DeviceMajor:0 DeviceMinor:63 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/db2a554a-660a-4b82-8e0e-70eaac7d1136/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:250 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:294 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-314 DeviceMajor:0 DeviceMinor:314 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-377 DeviceMajor:0 DeviceMinor:377 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ad22e71cff5ad7843215a4d818d74404e5a6a5a3ad3d5ff31e231382eefb9d66/userdata/shm DeviceMajor:0 DeviceMinor:418 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/cf440cad-3487-46a5-9d2d-4badf508cbe1/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:59 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea/volumes/kubernetes.io~projected/kube-api-access-hxgrv DeviceMajor:0 DeviceMinor:202 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/db2a554a-660a-4b82-8e0e-70eaac7d1136/volumes/kubernetes.io~projected/kube-api-access-j4kv5 DeviceMajor:0 DeviceMinor:260 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:290 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b37230d2516bdf52e266bef05d202602417fd93cb7881baeac3234c87afe7741/userdata/shm DeviceMajor:0 DeviceMinor:51 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9c5a2182-4c90-4ceb-b983-e7428f3a40be/volumes/kubernetes.io~projected/kube-api-access-nqhvd DeviceMajor:0 DeviceMinor:61 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:290 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-405 DeviceMajor:0 DeviceMinor:405 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3afc624431f8a97662a03146dedd3d5bf1a2e4366d630feac4c31e8595446ef2/userdata/shm DeviceMajor:0 DeviceMinor:307 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/26e3ee34-ace5-4eda-a96a-6c0014a989ee/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:197 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7164a2072ebbc5206a8613c13bc1bbc7230f1843ebbceff03f1d177e776a66c2/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3f67bd09-93fb-4738-b800-36b41330d329/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:283 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3f67bd09-93fb-4738-b800-36b41330d329/volumes/kubernetes.io~projected/kube-api-access-r8gn5 DeviceMajor:0 DeviceMinor:284 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:292 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:294 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-362 DeviceMajor:0 DeviceMinor:362 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c242f2eb-7d62-4990-84b0-04175eefc461/volumes/kubernetes.io~projected/kube-api-access-wpqvm DeviceMajor:0 DeviceMinor:57 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9707c16bb6a9c0396db9741abfe71eee71aedc4f00016666a8bf7e75832b17b6/userdata/shm DeviceMajor:0 DeviceMinor:388 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/eabae22ffdb87e7fe5d5dc202a254bbc8df37804387113d66bfedc8de72f9684/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/db2a554a-660a-4b82-8e0e-70eaac7d1136/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:254 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9f6c128be7cfaf7336c3e55c967b569835f1aff4e12f33ced41953dc6d55fe94/userdata/shm DeviceMajor:0 DeviceMinor:265 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:289 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:290 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-49 DeviceMajor:0 DeviceMinor:49 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/96855631-beca-4d91-814d-689668f6de56/volumes/kubernetes.io~projected/kube-api-access-sfl4s DeviceMajor:0 DeviceMinor:56 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/39954ddf-ace6-4e62-a9b4-5d12a77b202c/volumes/kubernetes.io~projected/kube-api-access-5lp9w DeviceMajor:0 DeviceMinor:204 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-426 DeviceMajor:0 DeviceMinor:426 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:296 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/cf440cad-3487-46a5-9d2d-4badf508cbe1/volumes/kubernetes.io~projected/kube-api-access-nm54c DeviceMajor:0 DeviceMinor:66 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d5b71c5c77a5dbada7375109bd6643a3c6252aa57d74481478287246e3dd79c9/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-225 DeviceMajor:0 DeviceMinor:225 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/081d2b6e-a762-4015-8a75-a43b0f6c9e66/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:246 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e38053e13fa5856c155196fce59ca2714040fd1dbfb4cb45f3da171a8add1be5/userdata/shm DeviceMajor:0 DeviceMinor:338 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/51c03abc-b77b-4b72-a707-293e13734fae/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/595f7603f5f2fe03f14228d78dc5a53c997b3d6b190092a9e5c8c725e0cf375e/userdata/shm DeviceMajor:0 DeviceMinor:261 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/96855631-beca-4d91-814d-689668f6de56/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:407 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-422 DeviceMajor:0 DeviceMinor:422 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/09213485-c715-420e-ab7d-c6cc3ee149a5/volumes/kubernetes.io~projected/kube-api-access-2chjr DeviceMajor:0 DeviceMinor:64 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f7d07647e9578409e683b2ffde035906843e842b6509af0778162e73571ce3d9/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/203705501eeff81f21d76b1b64495010efe192f9a39fd9e2a09eb720be6eb994/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d6cefe39-1545-44f8-a04c-d2dc001be4a4/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:382 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7af658ed-1cc4-4f7d-b9c8-c0437180bb43/volumes/kubernetes.io~projected/kube-api-access-lxqmf DeviceMajor:0 DeviceMinor:62 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0f15bf153451982e313c62a87824c6186713b92eef5c1d95cefe8eb8ead95213/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/96f7b920c99e1d236fafc58eb209c6b6020848d762518d5752e2729ce671b7c3/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b12672cc-5caf-4cce-90b1-babce76c4007/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:399 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-340 DeviceMajor:0 DeviceMinor:340 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-356 DeviceMajor:0 DeviceMinor:356 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/51c03abc-b77b-4b72-a707-293e13734fae/volumes/kubernetes.io~projected/kube-api-access-lqj94 DeviceMajor:0 DeviceMinor:67 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7687c626b27a4f2a5ac248780f34f95a551c2a479d8636a2e0452d365276a21f/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:34186d5a792d0c8 MacAddress:5e:4a:46:ea:bf:d6 Speed:10000 Mtu:8901} {Name:3afc624431f8a97 MacAddress:72:a9:27:a7:b0:48 Speed:10000 Mtu:8901} {Name:7164a2072ebbc52 MacAddress:72:75:0d:a3:5c:9a Speed:10000 Mtu:8901} {Name:7687c626b27a4f2 MacAddress:da:62:53:df:95:69 Speed:10000 Mtu:8901} {Name:7981587290d1c0f MacAddress:02:f3:13:4d:84:84 Speed:10000 Mtu:8901} {Name:9707c16bb6a9c03 MacAddress:7e:53:04:04:3e:52 Speed:10000 Mtu:8901} {Name:9f6c128be7cfaf7 MacAddress:a6:37:b3:d8:0f:0a Speed:10000 Mtu:8901} {Name:abdee1768829bac MacAddress:8a:b0:ba:35:bd:4d Speed:10000 Mtu:8901} {Name:ad22e71cff5ad78 MacAddress:f6:2c:57:24:36:77 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:06:ff:d6:56:22:e1 Speed:0 Mtu:9001} {Name:br-int MacAddress:3e:65:bf:ff:f2:3a Speed:0 Mtu:8901} {Name:c5e29cbdf14d41b MacAddress:3e:6c:60:b7:89:2e Speed:10000 Mtu:8901} {Name:d5b71c5c77a5dba MacAddress:42:cb:da:b4:f9:b2 Speed:10000 Mtu:8901} {Name:e38053e13fa5856 MacAddress:c2:82:19:67:85:f4 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:06:ff:d6:56:22:e1 Speed:0 Mtu:9001} {Name:f81899f315147c0 MacAddress:9e:87:af:b4:d7:78 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:52:00:a7:71:50:3e Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:3e:36:cd:39:10:a4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164337152 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 04 01:11:17.513261 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.511265    5640 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 04 01:11:17.513261 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.511313    5640 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 04 01:11:17.513261 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.511609    5640 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 04 01:11:17.513261 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.511631    5640 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-51.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 04 01:11:17.513261 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.511792    5640 topology_manager.go:143] "Creating topology manager with none policy"
Nov 04 01:11:17.513261 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.511801    5640 container_manager_linux.go:311] "Creating device plugin manager"
Nov 04 01:11:17.513261 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.511811    5640 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 01:11:17.513261 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.511831    5640 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 01:11:17.513261 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.511934    5640 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 04 01:11:17.513261 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.512143    5640 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 04 01:11:17.513261 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.512261    5640 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 04 01:11:17.513261 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.512300    5640 kubelet.go:493] "Attempting to sync node with API server"
Nov 04 01:11:17.513261 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.512312    5640 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 04 01:11:17.513261 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.512323    5640 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 04 01:11:17.513261 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.512333    5640 kubelet.go:405] "Adding apiserver pod source"
Nov 04 01:11:17.513261 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.512341    5640 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 04 01:11:17.513261 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.513243    5640 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 04 01:11:17.513261 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.513259    5640 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 01:11:17.514457 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.514416    5640 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 04 01:11:17.517894 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.517876    5640 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 04 01:11:17.517894 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.517893    5640 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 01:11:17.518029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.518014    5640 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Nov 04 01:11:17.518219 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.518208    5640 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 04 01:11:17.518249 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.518237    5640 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 04 01:11:17.518334 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.518325    5640 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 04 01:11:17.518364 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.518339    5640 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 04 01:11:17.518364 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.518345    5640 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 04 01:11:17.518364 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.518351    5640 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 04 01:11:17.518364 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.518357    5640 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 04 01:11:17.518364 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.518364    5640 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 04 01:11:17.518495 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.518370    5640 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 04 01:11:17.518495 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.518376    5640 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 04 01:11:17.518495 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.518383    5640 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 04 01:11:17.518495 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.518388    5640 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 04 01:11:17.518495 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.518397    5640 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 04 01:11:17.518495 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.518407    5640 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 04 01:11:17.518495 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.518428    5640 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 04 01:11:17.518495 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.518434    5640 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 04 01:11:17.521834 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.521821    5640 server.go:1263] "Started kubelet"
Nov 04 01:11:17.522238 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.521904    5640 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 04 01:11:17.522238 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.521944    5640 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 04 01:11:17.522238 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.522041    5640 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 04 01:11:17.522426 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.522369    5640 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 04 01:11:17.522397 ip-10-0-131-51 systemd[1]: Started Kubernetes Kubelet.
Nov 04 01:11:17.523350 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.523309    5640 server.go:317] "Adding debug handlers to kubelet server"
Nov 04 01:11:17.525250 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.525233    5640 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 04 01:11:17.525250 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.525249    5640 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 04 01:11:17.525458 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.525336    5640 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 04 01:11:17.525458 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.525350    5640 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 04 01:11:17.525618 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.525485    5640 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 04 01:11:17.525618 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:11:17.525577    5640 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-51.us-west-2.compute.internal\" not found"
Nov 04 01:11:17.525757 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.525726    5640 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 01:05:07 +0000 UTC" deadline="2028-05-14 14:47:52.785753862 +0000 UTC"
Nov 04 01:11:17.525957 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.525759    5640 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13381h36m35.259998405s"
Nov 04 01:11:17.528876 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.528817    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c242f2eb-7d62-4990-84b0-04175eefc461" volumeName="kubernetes.io/empty-dir/c242f2eb-7d62-4990-84b0-04175eefc461-tmp-dir" seLinuxMountContext=""
Nov 04 01:11:17.529021 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.528879    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39954ddf-ace6-4e62-a9b4-5d12a77b202c" volumeName="kubernetes.io/projected/39954ddf-ace6-4e62-a9b4-5d12a77b202c-kube-api-access-5lp9w" seLinuxMountContext=""
Nov 04 01:11:17.529021 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.528893    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4f257650-743f-417e-af55-250ef2606e4a" volumeName="kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-cluster-tls-config" seLinuxMountContext=""
Nov 04 01:11:17.529021 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.528909    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4fc117ae-0111-4ce2-9676-f125a8b64be9" volumeName="kubernetes.io/configmap/4fc117ae-0111-4ce2-9676-f125a8b64be9-multus-daemon-config" seLinuxMountContext=""
Nov 04 01:11:17.529021 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.528922    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b12672cc-5caf-4cce-90b1-babce76c4007" volumeName="kubernetes.io/projected/b12672cc-5caf-4cce-90b1-babce76c4007-kube-api-access-kbs8l" seLinuxMountContext=""
Nov 04 01:11:17.529021 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.528933    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d6cefe39-1545-44f8-a04c-d2dc001be4a4" volumeName="kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-oauth-serving-cert" seLinuxMountContext=""
Nov 04 01:11:17.529021 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.528945    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="081d2b6e-a762-4015-8a75-a43b0f6c9e66" volumeName="kubernetes.io/secret/081d2b6e-a762-4015-8a75-a43b0f6c9e66-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Nov 04 01:11:17.529021 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.528956    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a5b0ed1-dd30-4117-9cd0-e8140080e8ea" volumeName="kubernetes.io/empty-dir/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea-tmp-dir" seLinuxMountContext=""
Nov 04 01:11:17.529021 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.528984    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="51c03abc-b77b-4b72-a707-293e13734fae" volumeName="kubernetes.io/configmap/51c03abc-b77b-4b72-a707-293e13734fae-ovnkube-config" seLinuxMountContext=""
Nov 04 01:11:17.529021 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.528997    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="51c03abc-b77b-4b72-a707-293e13734fae" volumeName="kubernetes.io/configmap/51c03abc-b77b-4b72-a707-293e13734fae-env-overrides" seLinuxMountContext=""
Nov 04 01:11:17.529021 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529010    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7af658ed-1cc4-4f7d-b9c8-c0437180bb43" volumeName="kubernetes.io/projected/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-kube-api-access-lxqmf" seLinuxMountContext=""
Nov 04 01:11:17.529021 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529021    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b12672cc-5caf-4cce-90b1-babce76c4007" volumeName="kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-service-ca" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529033    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b12672cc-5caf-4cce-90b1-babce76c4007" volumeName="kubernetes.io/secret/b12672cc-5caf-4cce-90b1-babce76c4007-console-serving-cert" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529047    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf440cad-3487-46a5-9d2d-4badf508cbe1" volumeName="kubernetes.io/empty-dir/cf440cad-3487-46a5-9d2d-4badf508cbe1-tmp" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529063    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="081d2b6e-a762-4015-8a75-a43b0f6c9e66" volumeName="kubernetes.io/secret/081d2b6e-a762-4015-8a75-a43b0f6c9e66-openshift-state-metrics-tls" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529074    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39732b86-9f58-44ea-925e-a5e45c676586" volumeName="kubernetes.io/configmap/39732b86-9f58-44ea-925e-a5e45c676586-konnectivity-ca" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529085    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3f67bd09-93fb-4738-b800-36b41330d329" volumeName="kubernetes.io/secret/3f67bd09-93fb-4738-b800-36b41330d329-console-oauth-config" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529097    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="42e12e95-3cc8-4393-93fb-087e19f92874" volumeName="kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529108    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a5b0ed1-dd30-4117-9cd0-e8140080e8ea" volumeName="kubernetes.io/projected/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea-kube-api-access-hxgrv" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529119    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4f257650-743f-417e-af55-250ef2606e4a" volumeName="kubernetes.io/empty-dir/4f257650-743f-417e-af55-250ef2606e4a-alertmanager-main-db" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529130    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4f257650-743f-417e-af55-250ef2606e4a" volumeName="kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-config-volume" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529142    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="51c03abc-b77b-4b72-a707-293e13734fae" volumeName="kubernetes.io/projected/51c03abc-b77b-4b72-a707-293e13734fae-kube-api-access-lqj94" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529155    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1f23f719-7430-4b54-9204-13d0c5bebf96" volumeName="kubernetes.io/configmap/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-accelerators-collector-config" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529168    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1f23f719-7430-4b54-9204-13d0c5bebf96" volumeName="kubernetes.io/secret/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-kube-rbac-proxy-config" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529181    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3f67bd09-93fb-4738-b800-36b41330d329" volumeName="kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-oauth-serving-cert" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529192    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4f257650-743f-417e-af55-250ef2606e4a" volumeName="kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-web-config" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529205    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4fc117ae-0111-4ce2-9676-f125a8b64be9" volumeName="kubernetes.io/projected/4fc117ae-0111-4ce2-9676-f125a8b64be9-kube-api-access-pt2dh" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529217    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe" volumeName="kubernetes.io/secret/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-client-ca-bundle" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529235    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96855631-beca-4d91-814d-689668f6de56" volumeName="kubernetes.io/projected/96855631-beca-4d91-814d-689668f6de56-kube-api-access-sfl4s" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529249    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b12672cc-5caf-4cce-90b1-babce76c4007" volumeName="kubernetes.io/empty-dir/b12672cc-5caf-4cce-90b1-babce76c4007-tmp" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529262    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3f67bd09-93fb-4738-b800-36b41330d329" volumeName="kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-service-ca" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529274    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9c5a2182-4c90-4ceb-b983-e7428f3a40be" volumeName="kubernetes.io/projected/9c5a2182-4c90-4ceb-b983-e7428f3a40be-kube-api-access-nqhvd" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529288    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="db2a554a-660a-4b82-8e0e-70eaac7d1136" volumeName="kubernetes.io/configmap/db2a554a-660a-4b82-8e0e-70eaac7d1136-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529309    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="db2a554a-660a-4b82-8e0e-70eaac7d1136" volumeName="kubernetes.io/secret/db2a554a-660a-4b82-8e0e-70eaac7d1136-kube-state-metrics-tls" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529322    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="081d2b6e-a762-4015-8a75-a43b0f6c9e66" volumeName="kubernetes.io/projected/081d2b6e-a762-4015-8a75-a43b0f6c9e66-kube-api-access-5r69h" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529335    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39954ddf-ace6-4e62-a9b4-5d12a77b202c" volumeName="kubernetes.io/secret/39954ddf-ace6-4e62-a9b4-5d12a77b202c-insights-runtime-extractor-tls" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529348    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a5b0ed1-dd30-4117-9cd0-e8140080e8ea" volumeName="kubernetes.io/secret/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea-metrics-tls" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529360    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4f257650-743f-417e-af55-250ef2606e4a" volumeName="kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-main-tls" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529372    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe" volumeName="kubernetes.io/secret/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-secret-metrics-server-tls" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529384    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d6cefe39-1545-44f8-a04c-d2dc001be4a4" volumeName="kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-service-ca" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529397    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d6cefe39-1545-44f8-a04c-d2dc001be4a4" volumeName="kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-trusted-ca-bundle" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529409    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d6cefe39-1545-44f8-a04c-d2dc001be4a4" volumeName="kubernetes.io/empty-dir/d6cefe39-1545-44f8-a04c-d2dc001be4a4-tmp" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529423    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26e3ee34-ace5-4eda-a96a-6c0014a989ee" volumeName="kubernetes.io/projected/26e3ee34-ace5-4eda-a96a-6c0014a989ee-kube-api-access-8bm95" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529435    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3f67bd09-93fb-4738-b800-36b41330d329" volumeName="kubernetes.io/projected/3f67bd09-93fb-4738-b800-36b41330d329-kube-api-access-r8gn5" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529451    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39954ddf-ace6-4e62-a9b4-5d12a77b202c" volumeName="kubernetes.io/configmap/39954ddf-ace6-4e62-a9b4-5d12a77b202c-kube-rbac-proxy-cm" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529464    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4f257650-743f-417e-af55-250ef2606e4a" volumeName="kubernetes.io/configmap/4f257650-743f-417e-af55-250ef2606e4a-alertmanager-trusted-ca-bundle" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529476    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4fc117ae-0111-4ce2-9676-f125a8b64be9" volumeName="kubernetes.io/configmap/4fc117ae-0111-4ce2-9676-f125a8b64be9-cni-binary-copy" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529488    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c242f2eb-7d62-4990-84b0-04175eefc461" volumeName="kubernetes.io/projected/c242f2eb-7d62-4990-84b0-04175eefc461-kube-api-access-wpqvm" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529500    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d6cefe39-1545-44f8-a04c-d2dc001be4a4" volumeName="kubernetes.io/secret/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-serving-cert" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529513    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="db2a554a-660a-4b82-8e0e-70eaac7d1136" volumeName="kubernetes.io/projected/db2a554a-660a-4b82-8e0e-70eaac7d1136-kube-api-access-j4kv5" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529526    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26e3ee34-ace5-4eda-a96a-6c0014a989ee" volumeName="kubernetes.io/secret/26e3ee34-ace5-4eda-a96a-6c0014a989ee-cert" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529537    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a5b0ed1-dd30-4117-9cd0-e8140080e8ea" volumeName="kubernetes.io/configmap/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea-config-volume" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529550    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4f257650-743f-417e-af55-250ef2606e4a" volumeName="kubernetes.io/empty-dir/4f257650-743f-417e-af55-250ef2606e4a-config-out" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529562    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe" volumeName="kubernetes.io/configmap/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-metrics-server-audit-profiles" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529574    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe" volumeName="kubernetes.io/empty-dir/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-audit-log" seLinuxMountContext=""
Nov 04 01:11:17.529563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529586    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d6cefe39-1545-44f8-a04c-d2dc001be4a4" volumeName="kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-config" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529608    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="db2a554a-660a-4b82-8e0e-70eaac7d1136" volumeName="kubernetes.io/configmap/db2a554a-660a-4b82-8e0e-70eaac7d1136-metrics-client-ca" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529621    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="db2a554a-660a-4b82-8e0e-70eaac7d1136" volumeName="kubernetes.io/empty-dir/db2a554a-660a-4b82-8e0e-70eaac7d1136-volume-directive-shadow" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529633    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="081d2b6e-a762-4015-8a75-a43b0f6c9e66" volumeName="kubernetes.io/configmap/081d2b6e-a762-4015-8a75-a43b0f6c9e66-metrics-client-ca" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529644    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="51c03abc-b77b-4b72-a707-293e13734fae" volumeName="kubernetes.io/secret/51c03abc-b77b-4b72-a707-293e13734fae-ovn-node-metrics-cert" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529657    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b12672cc-5caf-4cce-90b1-babce76c4007" volumeName="kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-console-config" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529668    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d6cefe39-1545-44f8-a04c-d2dc001be4a4" volumeName="kubernetes.io/secret/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-oauth-config" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529681    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1f23f719-7430-4b54-9204-13d0c5bebf96" volumeName="kubernetes.io/projected/1f23f719-7430-4b54-9204-13d0c5bebf96-kube-api-access-ckw42" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529693    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3f67bd09-93fb-4738-b800-36b41330d329" volumeName="kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-console-config" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529706    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4f257650-743f-417e-af55-250ef2606e4a" volumeName="kubernetes.io/configmap/4f257650-743f-417e-af55-250ef2606e4a-metrics-client-ca" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529719    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4f257650-743f-417e-af55-250ef2606e4a" volumeName="kubernetes.io/projected/4f257650-743f-417e-af55-250ef2606e4a-kube-api-access-cjkw7" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529732    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7af658ed-1cc4-4f7d-b9c8-c0437180bb43" volumeName="kubernetes.io/configmap/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-whereabouts-flatfile-configmap" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529744    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b12672cc-5caf-4cce-90b1-babce76c4007" volumeName="kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-trusted-ca-bundle" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529756    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf440cad-3487-46a5-9d2d-4badf508cbe1" volumeName="kubernetes.io/projected/cf440cad-3487-46a5-9d2d-4badf508cbe1-kube-api-access-nm54c" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529768    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe" volumeName="kubernetes.io/projected/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-kube-api-access-dtpwr" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529782    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf440cad-3487-46a5-9d2d-4badf508cbe1" volumeName="kubernetes.io/empty-dir/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-tuned" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529794    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1f23f719-7430-4b54-9204-13d0c5bebf96" volumeName="kubernetes.io/configmap/1f23f719-7430-4b54-9204-13d0c5bebf96-metrics-client-ca" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529806    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1f23f719-7430-4b54-9204-13d0c5bebf96" volumeName="kubernetes.io/empty-dir/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-textfile" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529818    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1f23f719-7430-4b54-9204-13d0c5bebf96" volumeName="kubernetes.io/secret/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-tls" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529830    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2db16eff-7518-4f50-b080-8208d5e756cc" volumeName="kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529842    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3f67bd09-93fb-4738-b800-36b41330d329" volumeName="kubernetes.io/secret/3f67bd09-93fb-4738-b800-36b41330d329-console-serving-cert" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529854    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4f257650-743f-417e-af55-250ef2606e4a" volumeName="kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529865    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="51c03abc-b77b-4b72-a707-293e13734fae" volumeName="kubernetes.io/configmap/51c03abc-b77b-4b72-a707-293e13734fae-ovnkube-script-lib" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529877    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="db2a554a-660a-4b82-8e0e-70eaac7d1136" volumeName="kubernetes.io/secret/db2a554a-660a-4b82-8e0e-70eaac7d1136-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529888    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3f67bd09-93fb-4738-b800-36b41330d329" volumeName="kubernetes.io/empty-dir/3f67bd09-93fb-4738-b800-36b41330d329-tmp" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529899    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4489ab7f-24b7-4845-aa8c-8344a0bbe5a2" volumeName="kubernetes.io/projected/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-kube-api-access-tjg74" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.529912    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4f257650-743f-417e-af55-250ef2606e4a" volumeName="kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.530242    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe" volumeName="kubernetes.io/configmap/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.530266    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7af658ed-1cc4-4f7d-b9c8-c0437180bb43" volumeName="kubernetes.io/configmap/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-cni-binary-copy" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.530289    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="09213485-c715-420e-ab7d-c6cc3ee149a5" volumeName="kubernetes.io/configmap/09213485-c715-420e-ab7d-c6cc3ee149a5-serviceca" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.530302    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="09213485-c715-420e-ab7d-c6cc3ee149a5" volumeName="kubernetes.io/projected/09213485-c715-420e-ab7d-c6cc3ee149a5-kube-api-access-2chjr" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.530314    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39732b86-9f58-44ea-925e-a5e45c676586" volumeName="kubernetes.io/secret/39732b86-9f58-44ea-925e-a5e45c676586-agent-certs" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.530332    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4f257650-743f-417e-af55-250ef2606e4a" volumeName="kubernetes.io/projected/4f257650-743f-417e-af55-250ef2606e4a-tls-assets" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.530374    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7af658ed-1cc4-4f7d-b9c8-c0437180bb43" volumeName="kubernetes.io/configmap/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-cni-sysctl-allowlist" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.530396    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b12672cc-5caf-4cce-90b1-babce76c4007" volumeName="kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-oauth-serving-cert" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.530410    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d6cefe39-1545-44f8-a04c-d2dc001be4a4" volumeName="kubernetes.io/projected/d6cefe39-1545-44f8-a04c-d2dc001be4a4-kube-api-access-gp4rk" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.530423    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39954ddf-ace6-4e62-a9b4-5d12a77b202c" volumeName="kubernetes.io/empty-dir/39954ddf-ace6-4e62-a9b4-5d12a77b202c-data-volume" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.530441    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4f257650-743f-417e-af55-250ef2606e4a" volumeName="kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.530455    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe" volumeName="kubernetes.io/secret/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-secret-metrics-server-client-certs" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.530476    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96855631-beca-4d91-814d-689668f6de56" volumeName="kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.530502    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9c5a2182-4c90-4ceb-b983-e7428f3a40be" volumeName="kubernetes.io/configmap/9c5a2182-4c90-4ceb-b983-e7428f3a40be-iptables-alerter-script" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.530516    5640 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b12672cc-5caf-4cce-90b1-babce76c4007" volumeName="kubernetes.io/secret/b12672cc-5caf-4cce-90b1-babce76c4007-console-oauth-config" seLinuxMountContext=""
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.530527    5640 reconstruct.go:97] "Volume reconstruction finished"
Nov 04 01:11:17.530940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.530540    5640 reconciler.go:29] "Reconciler: start to sync state"
Nov 04 01:11:17.532461 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.532423    5640 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 04 01:11:17.532461 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.532441    5640 factory.go:55] Registering systemd factory
Nov 04 01:11:17.532461 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.532451    5640 factory.go:223] Registration of the systemd container factory successfully
Nov 04 01:11:17.532758 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.532740    5640 factory.go:153] Registering CRI-O factory
Nov 04 01:11:17.532834 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.532761    5640 factory.go:223] Registration of the crio container factory successfully
Nov 04 01:11:17.532834 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.532789    5640 factory.go:103] Registering Raw factory
Nov 04 01:11:17.532834 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.532803    5640 manager.go:1199] Started watching for new ooms in manager
Nov 04 01:11:17.533197 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.533178    5640 manager.go:319] Starting recovery of all containers
Nov 04 01:11:17.555565 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.555517    5640 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 04 01:11:17.557173 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.557144    5640 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 04 01:11:17.557173 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.557172    5640 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 04 01:11:17.557368 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.557193    5640 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 04 01:11:17.557368 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:11:17.557237    5640 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Nov 04 01:11:17.591992 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.591933    5640 generic.go:356] "Generic (PLEG): container finished" podID="7af658ed-1cc4-4f7d-b9c8-c0437180bb43" containerID="2d19635722f0d9741ab846b42c32c502aa4fbd4435ede20599a5409ecb563f4b" exitCode=0
Nov 04 01:11:17.591992 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.591994    5640 generic.go:356] "Generic (PLEG): container finished" podID="7af658ed-1cc4-4f7d-b9c8-c0437180bb43" containerID="443e4ee7f7fc3325edc83ea871dbabb78c636b01286376a47c04d822596f4fcc" exitCode=0
Nov 04 01:11:17.592170 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.592006    5640 generic.go:356] "Generic (PLEG): container finished" podID="7af658ed-1cc4-4f7d-b9c8-c0437180bb43" containerID="cba4caf1b8a322c8f5f137fa656dfd0a41dc7d13e17bc359e3e0cd5b78144eb5" exitCode=0
Nov 04 01:11:17.592170 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.592019    5640 generic.go:356] "Generic (PLEG): container finished" podID="7af658ed-1cc4-4f7d-b9c8-c0437180bb43" containerID="e9ed433d1d019f25726510aa0007cd3de8aac90981c0927278c18ebc3835cb62" exitCode=0
Nov 04 01:11:17.592170 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.592029    5640 generic.go:356] "Generic (PLEG): container finished" podID="7af658ed-1cc4-4f7d-b9c8-c0437180bb43" containerID="b8871c663d7b4837eb21892e173b1d7821bfdbd640dd2e0382ac5c9624248494" exitCode=0
Nov 04 01:11:17.592170 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.592038    5640 generic.go:356] "Generic (PLEG): container finished" podID="7af658ed-1cc4-4f7d-b9c8-c0437180bb43" containerID="5e93cabe44ed6b486f165cdf87587f7883880ffc96ec7c9211f6f7c27bea074d" exitCode=0
Nov 04 01:11:17.593878 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.593844    5640 generic.go:356] "Generic (PLEG): container finished" podID="f2aa811e393ce1519559d6514adffb05" containerID="ffc91ca8b0ce45dac2e1fa783cf1ae7999eb2a966f415961f751c876c51dbc56" exitCode=0
Nov 04 01:11:17.608504 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.608473    5640 generic.go:356] "Generic (PLEG): container finished" podID="4f257650-743f-417e-af55-250ef2606e4a" containerID="0fb89146deebf4e8e68877b7ad34f8913492768c82e500ad5f4ca27a85c5ee29" exitCode=0
Nov 04 01:11:17.612305 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.612279    5640 generic.go:356] "Generic (PLEG): container finished" podID="1f23f719-7430-4b54-9204-13d0c5bebf96" containerID="58b5e3ad667d445aa4f39bfb1d5d17abd4f88648b315c0a2d191c8d6ab9704fc" exitCode=0
Nov 04 01:11:17.625659 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:11:17.625628    5640 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-51.us-west-2.compute.internal\" not found"
Nov 04 01:11:17.639096 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.639072    5640 manager.go:324] Recovery completed
Nov 04 01:11:17.657447 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:11:17.657365    5640 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Nov 04 01:11:17.661000 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.660984    5640 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 01:11:17.663319 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.663303    5640 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 01:11:17.663391 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.663332    5640 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 01:11:17.663391 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.663345    5640 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 01:11:17.666163 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.666145    5640 cpu_manager.go:226] "Starting" policy="none"
Nov 04 01:11:17.666163 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.666161    5640 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 04 01:11:17.666279 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.666172    5640 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 01:11:17.666279 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.666184    5640 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 04 01:11:17.666361 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.666343    5640 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Nov 04 01:11:17.666397 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.666374    5640 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Nov 04 01:11:17.666397 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.666392    5640 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Nov 04 01:11:17.666397 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.666397    5640 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Nov 04 01:11:17.666481 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.666403    5640 policy_none.go:50] "Start"
Nov 04 01:11:17.666481 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.666414    5640 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 04 01:11:17.666481 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.666424    5640 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 04 01:11:17.666569 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.666559    5640 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Nov 04 01:11:17.666598 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.666569    5640 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Nov 04 01:11:17.666598 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.666575    5640 policy_none.go:44] "Start"
Nov 04 01:11:17.667539 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.667522    5640 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 01:11:17.667597 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.667556    5640 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 01:11:17.667597 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.667575    5640 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 01:11:17.671340 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.671312    5640 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 04 01:11:17.673826 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.673815    5640 manager.go:341] "Starting Device Plugin manager"
Nov 04 01:11:17.673875 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:11:17.673841    5640 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 04 01:11:17.673875 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.673850    5640 server.go:87] "Starting device plugin registration server"
Nov 04 01:11:17.674138 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.674127    5640 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 04 01:11:17.674172 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.674141    5640 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 04 01:11:17.674276 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.674253    5640 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 04 01:11:17.674414 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.674374    5640 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 04 01:11:17.674490 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.674427    5640 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 04 01:11:17.674490 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.674434    5640 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 04 01:11:17.674580 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.674491    5640 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T01:11:17.674413044Z","UUID":"36d32127-a55e-448e-ac07-3f7178190436","Handler":null,"Name":"","Endpoint":""}
Nov 04 01:11:17.678433 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:11:17.678405    5640 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 04 01:11:17.678531 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:11:17.678455    5640 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-51.us-west-2.compute.internal\" not found"
Nov 04 01:11:17.679000 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.678959    5640 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 04 01:11:17.679094 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.679020    5640 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 04 01:11:17.734804 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.734774    5640 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 01:11:17.734804 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.734805    5640 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 01:11:17.735805 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.735785    5640 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Nov 04 01:11:17.735805 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.735789    5640 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 01:11:17.774858 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.774822    5640 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 01:11:17.776080 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.776063    5640 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 01:11:17.776168 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.776093    5640 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 01:11:17.776168 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.776105    5640 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-51.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 01:11:17.776168 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.776150    5640 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:11:17.837268 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.837237    5640 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 01:11:17.857696 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.857646    5640 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal"]
Nov 04 01:11:17.858352 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.858307    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal" event={"ID":"a8e9fbe3308d7a9dc37557b42c180c40","Type":"ContainerStarted","Data":"7cd0a42b91e3448f112d64955349d3ea416b60e3800ed67fbdf0cdd70dbb2afd"}
Nov 04 01:11:17.858386 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.858372    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal" event={"ID":"a8e9fbe3308d7a9dc37557b42c180c40","Type":"ContainerStarted","Data":"b37230d2516bdf52e266bef05d202602417fd93cb7881baeac3234c87afe7741"}
Nov 04 01:11:17.858432 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.858412    5640 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:11:17.858432 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.858333    5640 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:11:17.858490 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.858439    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal" event={"ID":"f2aa811e393ce1519559d6514adffb05","Type":"ContainerStarted","Data":"1f107e96986ce7d1e8255b9dbbcbdd5231b3a2f2961d5d3f7c8107850faaf27f"}
Nov 04 01:11:17.858490 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.858462    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal" event={"ID":"f2aa811e393ce1519559d6514adffb05","Type":"ContainerDied","Data":"ffc91ca8b0ce45dac2e1fa783cf1ae7999eb2a966f415961f751c876c51dbc56"}
Nov 04 01:11:17.858490 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.858479    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal" event={"ID":"f2aa811e393ce1519559d6514adffb05","Type":"ContainerStarted","Data":"caa3d106e523f500050b2ce2c243d91398b475c5456130fd52d6b07324c37371"}
Nov 04 01:11:17.893189 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.893167    5640 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:11:17.893257 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.893238    5640 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:11:17.921145 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.921074    5640 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 01:11:17.921145 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:11:17.921133    5640 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:11:17.921581 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.921564    5640 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 01:11:17.921612 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:11:17.921604    5640 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:11:17.936974 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.936947    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a8e9fbe3308d7a9dc37557b42c180c40-config\") pod \"kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal\" (UID: \"a8e9fbe3308d7a9dc37557b42c180c40\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:11:17.937027 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.937011    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f2aa811e393ce1519559d6514adffb05-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal\" (UID: \"f2aa811e393ce1519559d6514adffb05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:11:17.937059 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:17.937042    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2aa811e393ce1519559d6514adffb05-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal\" (UID: \"f2aa811e393ce1519559d6514adffb05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:11:18.037819 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.037775    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a8e9fbe3308d7a9dc37557b42c180c40-config\") pod \"kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal\" (UID: \"a8e9fbe3308d7a9dc37557b42c180c40\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:11:18.037819 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.037822    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f2aa811e393ce1519559d6514adffb05-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal\" (UID: \"f2aa811e393ce1519559d6514adffb05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:11:18.038056 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.037843    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2aa811e393ce1519559d6514adffb05-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal\" (UID: \"f2aa811e393ce1519559d6514adffb05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:11:18.038056 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.037883    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2aa811e393ce1519559d6514adffb05-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal\" (UID: \"f2aa811e393ce1519559d6514adffb05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:11:18.038056 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.037886    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a8e9fbe3308d7a9dc37557b42c180c40-config\") pod \"kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal\" (UID: \"a8e9fbe3308d7a9dc37557b42c180c40\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:11:18.038056 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.037887    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f2aa811e393ce1519559d6514adffb05-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal\" (UID: \"f2aa811e393ce1519559d6514adffb05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:11:18.512636 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.512603    5640 apiserver.go:52] "Watching apiserver"
Nov 04 01:11:18.618157 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.618126    5640 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:11:18.618338 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.618321    5640 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:11:18.619825 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.619807    5640 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 04 01:11:18.620480 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.620459    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xlwwn","openshift-monitoring/metrics-server-77d5fd7b89-6zr4t","openshift-ovn-kubernetes/ovnkube-node-4glcp","openshift-cluster-node-tuning-operator/tuned-7q5cg","openshift-multus/multus-additional-cni-plugins-25q95","openshift-multus/network-metrics-daemon-fq4qm","kube-system/kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal","openshift-console/console-5fd47659d6-bl52s","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft","openshift-monitoring/alertmanager-main-0","openshift-console/console-bd6bc57c4-p8hhs","openshift-image-registry/node-ca-n8xrm","openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f","openshift-monitoring/node-exporter-lc7jc","kube-system/global-pull-secret-syncer-nrlb9","kube-system/konnectivity-agent-vktnk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal","openshift-multus/multus-h9lvw","openshift-ingress-canary/ingress-canary-25blp","openshift-console/console-865f8db98-82tkl","openshift-insights/insights-runtime-extractor-mmvnr","openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv","openshift-dns/node-resolver-dzffv","openshift-network-diagnostics/network-check-target-zq545","openshift-network-operator/iptables-alerter-jz7tt"]
Nov 04 01:11:18.641706 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.641677    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c5a2182-4c90-4ceb-b983-e7428f3a40be-host-slash\") pod \"iptables-alerter-jz7tt\" (UID: \"9c5a2182-4c90-4ceb-b983-e7428f3a40be\") " pod="openshift-network-operator/iptables-alerter-jz7tt"
Nov 04 01:11:18.641883 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.641749    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-multus-cni-dir\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.641883 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.641809    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-lib-modules\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.641883 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.641865    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs\") pod \"network-metrics-daemon-fq4qm\" (UID: \"96855631-beca-4d91-814d-689668f6de56\") " pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:11:18.642034 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.641930    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-run-openvswitch\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.642034 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.641953    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-run-ovn-kubernetes\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.642034 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642018    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-cni-bin\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.642130 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642055    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-cni-binary-copy\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:11:18.642130 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642073    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-systemd\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.642184 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642144    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-host\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.642184 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642171    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-system-cni-dir\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:11:18.642243 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642190    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret\") pod \"global-pull-secret-syncer-nrlb9\" (UID: \"42e12e95-3cc8-4393-93fb-087e19f92874\") " pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:11:18.642282 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642258    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-var-lib-cni-bin\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.642312 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642296    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c242f2eb-7d62-4990-84b0-04175eefc461-hosts-file\") pod \"node-resolver-dzffv\" (UID: \"c242f2eb-7d62-4990-84b0-04175eefc461\") " pod="openshift-dns/node-resolver-dzffv"
Nov 04 01:11:18.642341 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642327    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-cnibin\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:11:18.642408 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642369    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-etc-kubernetes\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.642408 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642390    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-run-netns\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.642497 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642408    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/51c03abc-b77b-4b72-a707-293e13734fae-ovn-node-metrics-cert\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.642497 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642432    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-tuning-conf-dir\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:11:18.642497 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642451    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:11:18.642580 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642500    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxqmf\" (UniqueName: \"kubernetes.io/projected/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-kube-api-access-lxqmf\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:11:18.642580 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642539    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-kubelet\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.642580 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642564    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56tjz\" (UniqueName: \"kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz\") pod \"network-check-target-zq545\" (UID: \"2db16eff-7518-4f50-b080-8208d5e756cc\") " pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:11:18.642658 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642617    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-modprobe-d\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.642658 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642651    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-run\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.642722 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642675    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-tuned\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.642763 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642728    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/51c03abc-b77b-4b72-a707-293e13734fae-ovnkube-script-lib\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.642763 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642759    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-tuned\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.642830 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642799    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqj94\" (UniqueName: \"kubernetes.io/projected/51c03abc-b77b-4b72-a707-293e13734fae-kube-api-access-lqj94\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.642872 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642835    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-hostroot\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.642872 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642853    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-run-multus-certs\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.642981 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642881    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt2dh\" (UniqueName: \"kubernetes.io/projected/4fc117ae-0111-4ce2-9676-f125a8b64be9-kube-api-access-pt2dh\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.642981 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642908    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-device-dir\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:11:18.642981 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642930    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-etc-openvswitch\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.642981 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.642958    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-log-socket\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.643119 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643001    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-var-lib-kubelet\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.643119 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643097    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4fc117ae-0111-4ce2-9676-f125a8b64be9-multus-daemon-config\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.643185 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643132    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-sys-fs\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:11:18.643185 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643167    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-node-log\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.643185 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643184    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-cni-netd\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.643287 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643211    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-multus-socket-dir-parent\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.643287 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643232    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-var-lib-kubelet\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.643287 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643257    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfl4s\" (UniqueName: \"kubernetes.io/projected/96855631-beca-4d91-814d-689668f6de56-kube-api-access-sfl4s\") pod \"network-metrics-daemon-fq4qm\" (UID: \"96855631-beca-4d91-814d-689668f6de56\") " pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:11:18.643364 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643291    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-socket-dir\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:11:18.643434 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643421    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/51c03abc-b77b-4b72-a707-293e13734fae-ovnkube-config\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.643465 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643445    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/42e12e95-3cc8-4393-93fb-087e19f92874-kubelet-config\") pod \"global-pull-secret-syncer-nrlb9\" (UID: \"42e12e95-3cc8-4393-93fb-087e19f92874\") " pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:11:18.643495 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643469    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/42e12e95-3cc8-4393-93fb-087e19f92874-dbus\") pod \"global-pull-secret-syncer-nrlb9\" (UID: \"42e12e95-3cc8-4393-93fb-087e19f92874\") " pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:11:18.643540 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643493    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-sysconfig\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.643540 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643520    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjg74\" (UniqueName: \"kubernetes.io/projected/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-kube-api-access-tjg74\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:11:18.643627 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643562    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c242f2eb-7d62-4990-84b0-04175eefc461-tmp-dir\") pod \"node-resolver-dzffv\" (UID: \"c242f2eb-7d62-4990-84b0-04175eefc461\") " pod="openshift-dns/node-resolver-dzffv"
Nov 04 01:11:18.643678 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643665    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-var-lib-openvswitch\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.643746 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643676    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c242f2eb-7d62-4990-84b0-04175eefc461-tmp-dir\") pod \"node-resolver-dzffv\" (UID: \"c242f2eb-7d62-4990-84b0-04175eefc461\") " pod="openshift-dns/node-resolver-dzffv"
Nov 04 01:11:18.643746 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643695    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:11:18.643746 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643714    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-sysctl-conf\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.643746 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643729    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm54c\" (UniqueName: \"kubernetes.io/projected/cf440cad-3487-46a5-9d2d-4badf508cbe1-kube-api-access-nm54c\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.643911 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643755    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:11:18.643911 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643788    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c5a2182-4c90-4ceb-b983-e7428f3a40be-iptables-alerter-script\") pod \"iptables-alerter-jz7tt\" (UID: \"9c5a2182-4c90-4ceb-b983-e7428f3a40be\") " pod="openshift-network-operator/iptables-alerter-jz7tt"
Nov 04 01:11:18.643911 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643892    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-run-ovn\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.644052 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643941    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpqvm\" (UniqueName: \"kubernetes.io/projected/c242f2eb-7d62-4990-84b0-04175eefc461-kube-api-access-wpqvm\") pod \"node-resolver-dzffv\" (UID: \"c242f2eb-7d62-4990-84b0-04175eefc461\") " pod="openshift-dns/node-resolver-dzffv"
Nov 04 01:11:18.644052 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.643984    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-var-lib-cni-multus\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.644052 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.644010    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-run-systemd\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.644052 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.644036    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-system-cni-dir\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.644204 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.644062    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4fc117ae-0111-4ce2-9676-f125a8b64be9-cni-binary-copy\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.644204 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.644088    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-run-netns\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.644204 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.644110    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-sys\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.644322 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.644206    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf440cad-3487-46a5-9d2d-4badf508cbe1-tmp\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.644322 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.644240    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-registration-dir\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:11:18.644322 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.644306    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf440cad-3487-46a5-9d2d-4badf508cbe1-tmp\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.644427 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.644343    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/39732b86-9f58-44ea-925e-a5e45c676586-agent-certs\") pod \"konnectivity-agent-vktnk\" (UID: \"39732b86-9f58-44ea-925e-a5e45c676586\") " pod="kube-system/konnectivity-agent-vktnk"
Nov 04 01:11:18.644427 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.644364    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/51c03abc-b77b-4b72-a707-293e13734fae-env-overrides\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.644427 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.644381    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/39732b86-9f58-44ea-925e-a5e45c676586-konnectivity-ca\") pod \"konnectivity-agent-vktnk\" (UID: \"39732b86-9f58-44ea-925e-a5e45c676586\") " pod="kube-system/konnectivity-agent-vktnk"
Nov 04 01:11:18.644427 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.644397    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqhvd\" (UniqueName: \"kubernetes.io/projected/9c5a2182-4c90-4ceb-b983-e7428f3a40be-kube-api-access-nqhvd\") pod \"iptables-alerter-jz7tt\" (UID: \"9c5a2182-4c90-4ceb-b983-e7428f3a40be\") " pod="openshift-network-operator/iptables-alerter-jz7tt"
Nov 04 01:11:18.644427 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.644415    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-systemd-units\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.644597 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.644430    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-cnibin\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.644597 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.644451    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-run-k8s-cni-cncf-io\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.644597 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.644524    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-sysctl-d\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.644597 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.644547    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.644597 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.644563    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-slash\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.644597 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.644588    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-multus-conf-dir\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.644759 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.644615    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-kubernetes\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.644759 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.644635    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:11:18.675349 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.675305    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-rjcnb\""
Nov 04 01:11:18.675349 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.675305    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hz84q\""
Nov 04 01:11:18.676048 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.676027    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 04 01:11:18.676312 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.676299    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 04 01:11:18.680054 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.680034    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 04 01:11:18.680157 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.680131    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 04 01:11:18.680212 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.680159    5640 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 01:11:18.680212 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.680172    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 04 01:11:18.680326 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:11:18.680214    5640 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:11:18.680371 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.680352    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q5jlj\""
Nov 04 01:11:18.680721 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.680546    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 04 01:11:18.680721 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.680600    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 04 01:11:18.680721 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.680638    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 04 01:11:18.680721 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.680606    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4z2qg\""
Nov 04 01:11:18.680721 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.680618    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 04 01:11:18.680721 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.680664    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 04 01:11:18.680721 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.680688    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 04 01:11:18.680721 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.680694    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 04 01:11:18.680721 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.680695    5640 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 01:11:18.680721 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.680635    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 04 01:11:18.680721 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.680719    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 04 01:11:18.681135 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:11:18.680770    5640 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-51.us-west-2.compute.internal"
Nov 04 01:11:18.681135 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.680805    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 04 01:11:18.681135 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.681024    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 04 01:11:18.681135 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.681040    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d8jdw\""
Nov 04 01:11:18.681135 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.681057    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 04 01:11:18.681135 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.681075    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-7mrtt\""
Nov 04 01:11:18.681135 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.681087    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 04 01:11:18.681135 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.681078    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 04 01:11:18.681135 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.681110    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-prqm6\""
Nov 04 01:11:18.681135 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.681099    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 04 01:11:18.681135 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.681078    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 04 01:11:18.681135 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.681112    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 04 01:11:18.681471 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.681165    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 04 01:11:18.681471 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.681207    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g9sbp\""
Nov 04 01:11:18.681471 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.681226    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 04 01:11:18.682007 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.681992    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 04 01:11:18.682065 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.681999    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8lz6w\""
Nov 04 01:11:18.682136 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.682119    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 04 01:11:18.682196 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.682177    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96855631-beca-4d91-814d-689668f6de56-metrics-certs\") pod \"network-metrics-daemon-fq4qm\" (UID: \"96855631-beca-4d91-814d-689668f6de56\") " pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:11:18.682274 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.682181    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-x4nsn\""
Nov 04 01:11:18.682400 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.682291    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 04 01:11:18.682400 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.682295    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 04 01:11:18.682400 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.682299    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 04 01:11:18.682510 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.682406    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 04 01:11:18.682510 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.682420    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-cni-binary-copy\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:11:18.682510 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.682471    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j9t67\""
Nov 04 01:11:18.682605 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.682545    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-9dncz\""
Nov 04 01:11:18.682605 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.682592    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-8hhs6\""
Nov 04 01:11:18.682661 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.682633    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 04 01:11:18.682690 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.682673    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 04 01:11:18.682721 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.682707    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/51c03abc-b77b-4b72-a707-293e13734fae-ovn-node-metrics-cert\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.682758 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.682725    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:11:18.683603 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.683584    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4fc117ae-0111-4ce2-9676-f125a8b64be9-multus-daemon-config\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.683675 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.683634    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/51c03abc-b77b-4b72-a707-293e13734fae-ovnkube-script-lib\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.683675 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.683643    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/51c03abc-b77b-4b72-a707-293e13734fae-ovnkube-config\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.684788 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.684767    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/51c03abc-b77b-4b72-a707-293e13734fae-env-overrides\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.684788 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.684782    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/39732b86-9f58-44ea-925e-a5e45c676586-konnectivity-ca\") pod \"konnectivity-agent-vktnk\" (UID: \"39732b86-9f58-44ea-925e-a5e45c676586\") " pod="kube-system/konnectivity-agent-vktnk"
Nov 04 01:11:18.684899 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.684830    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c5a2182-4c90-4ceb-b983-e7428f3a40be-iptables-alerter-script\") pod \"iptables-alerter-jz7tt\" (UID: \"9c5a2182-4c90-4ceb-b983-e7428f3a40be\") " pod="openshift-network-operator/iptables-alerter-jz7tt"
Nov 04 01:11:18.684899 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.684851    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4fc117ae-0111-4ce2-9676-f125a8b64be9-cni-binary-copy\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.684899 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.684859    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/39732b86-9f58-44ea-925e-a5e45c676586-agent-certs\") pod \"konnectivity-agent-vktnk\" (UID: \"39732b86-9f58-44ea-925e-a5e45c676586\") " pod="kube-system/konnectivity-agent-vktnk"
Nov 04 01:11:18.685027 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.684913    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:11:18.693233 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.693203    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42e12e95-3cc8-4393-93fb-087e19f92874-original-pull-secret\") pod \"global-pull-secret-syncer-nrlb9\" (UID: \"42e12e95-3cc8-4393-93fb-087e19f92874\") " pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:11:18.728043 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.728011    5640 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 04 01:11:18.741004 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.740963    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfl4s\" (UniqueName: \"kubernetes.io/projected/96855631-beca-4d91-814d-689668f6de56-kube-api-access-sfl4s\") pod \"network-metrics-daemon-fq4qm\" (UID: \"96855631-beca-4d91-814d-689668f6de56\") " pod="openshift-multus/network-metrics-daemon-fq4qm"
Nov 04 01:11:18.741145 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.740963    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqhvd\" (UniqueName: \"kubernetes.io/projected/9c5a2182-4c90-4ceb-b983-e7428f3a40be-kube-api-access-nqhvd\") pod \"iptables-alerter-jz7tt\" (UID: \"9c5a2182-4c90-4ceb-b983-e7428f3a40be\") " pod="openshift-network-operator/iptables-alerter-jz7tt"
Nov 04 01:11:18.741145 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.741058    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpqvm\" (UniqueName: \"kubernetes.io/projected/c242f2eb-7d62-4990-84b0-04175eefc461-kube-api-access-wpqvm\") pod \"node-resolver-dzffv\" (UID: \"c242f2eb-7d62-4990-84b0-04175eefc461\") " pod="openshift-dns/node-resolver-dzffv"
Nov 04 01:11:18.741673 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.741641    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt2dh\" (UniqueName: \"kubernetes.io/projected/4fc117ae-0111-4ce2-9676-f125a8b64be9-kube-api-access-pt2dh\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.741845 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.741824    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqj94\" (UniqueName: \"kubernetes.io/projected/51c03abc-b77b-4b72-a707-293e13734fae-kube-api-access-lqj94\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.741879 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.741839    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjg74\" (UniqueName: \"kubernetes.io/projected/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-kube-api-access-tjg74\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:11:18.741879 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.741842    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56tjz\" (UniqueName: \"kubernetes.io/projected/2db16eff-7518-4f50-b080-8208d5e756cc-kube-api-access-56tjz\") pod \"network-check-target-zq545\" (UID: \"2db16eff-7518-4f50-b080-8208d5e756cc\") " pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:11:18.741944 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.741892    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxqmf\" (UniqueName: \"kubernetes.io/projected/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-kube-api-access-lxqmf\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:11:18.742254 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.742238    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm54c\" (UniqueName: \"kubernetes.io/projected/cf440cad-3487-46a5-9d2d-4badf508cbe1-kube-api-access-nm54c\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.745555 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.745540    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c242f2eb-7d62-4990-84b0-04175eefc461-hosts-file\") pod \"node-resolver-dzffv\" (UID: \"c242f2eb-7d62-4990-84b0-04175eefc461\") " pod="openshift-dns/node-resolver-dzffv"
Nov 04 01:11:18.745594 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.745563    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-etc-kubernetes\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.745594 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.745579    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckw42\" (UniqueName: \"kubernetes.io/projected/1f23f719-7430-4b54-9204-13d0c5bebf96-kube-api-access-ckw42\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:11:18.745660 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.745595    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f257650-743f-417e-af55-250ef2606e4a-config-out\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.745660 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.745619    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f257650-743f-417e-af55-250ef2606e4a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.745660 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.745640    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-etc-kubernetes\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.745776 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.745660    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c242f2eb-7d62-4990-84b0-04175eefc461-hosts-file\") pod \"node-resolver-dzffv\" (UID: \"c242f2eb-7d62-4990-84b0-04175eefc461\") " pod="openshift-dns/node-resolver-dzffv"
Nov 04 01:11:18.745776 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.745685    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6cefe39-1545-44f8-a04c-d2dc001be4a4-tmp\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:18.745776 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.745707    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f257650-743f-417e-af55-250ef2606e4a-config-out\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.745776 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.745711    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/db2a554a-660a-4b82-8e0e-70eaac7d1136-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:11:18.745776 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.745740    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.745991 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.745782    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6cefe39-1545-44f8-a04c-d2dc001be4a4-tmp\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:18.745991 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.745819    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/081d2b6e-a762-4015-8a75-a43b0f6c9e66-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-mqzrv\" (UID: \"081d2b6e-a762-4015-8a75-a43b0f6c9e66\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"
Nov 04 01:11:18.745991 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.745824    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/db2a554a-660a-4b82-8e0e-70eaac7d1136-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:11:18.745991 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.745874    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-oauth-serving-cert\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:18.745991 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.745904    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2chjr\" (UniqueName: \"kubernetes.io/projected/09213485-c715-420e-ab7d-c6cc3ee149a5-kube-api-access-2chjr\") pod \"node-ca-n8xrm\" (UID: \"09213485-c715-420e-ab7d-c6cc3ee149a5\") " pod="openshift-image-registry/node-ca-n8xrm"
Nov 04 01:11:18.745991 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.745921    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-etc-openvswitch\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.745991 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.745937    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-log-socket\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.745991 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.745953    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea-config-volume\") pod \"dns-default-xlwwn\" (UID: \"4a5b0ed1-dd30-4117-9cd0-e8140080e8ea\") " pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:11:18.746351 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746010    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-log-socket\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.746351 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746031    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-service-ca\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:18.746351 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746055    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-var-lib-kubelet\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.746351 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746071    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-etc-openvswitch\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.746351 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746093    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-var-lib-kubelet\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.746351 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746101    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-node-log\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.746351 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746075    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-node-log\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.746351 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746146    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-oauth-serving-cert\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:11:18.746351 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746172    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-multus-socket-dir-parent\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.746351 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746188    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-socket-dir\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:11:18.746351 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746205    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/42e12e95-3cc8-4393-93fb-087e19f92874-kubelet-config\") pod \"global-pull-secret-syncer-nrlb9\" (UID: \"42e12e95-3cc8-4393-93fb-087e19f92874\") " pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:11:18.746351 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746223    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/42e12e95-3cc8-4393-93fb-087e19f92874-dbus\") pod \"global-pull-secret-syncer-nrlb9\" (UID: \"42e12e95-3cc8-4393-93fb-087e19f92874\") " pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:11:18.746351 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746280    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-socket-dir\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:11:18.746351 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746288    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/42e12e95-3cc8-4393-93fb-087e19f92874-dbus\") pod \"global-pull-secret-syncer-nrlb9\" (UID: \"42e12e95-3cc8-4393-93fb-087e19f92874\") " pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:11:18.746351 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746297    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/42e12e95-3cc8-4393-93fb-087e19f92874-kubelet-config\") pod \"global-pull-secret-syncer-nrlb9\" (UID: \"42e12e95-3cc8-4393-93fb-087e19f92874\") " pod="kube-system/global-pull-secret-syncer-nrlb9"
Nov 04 01:11:18.746351 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746306    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-config-volume\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.746351 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746335    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09213485-c715-420e-ab7d-c6cc3ee149a5-host\") pod \"node-ca-n8xrm\" (UID: \"09213485-c715-420e-ab7d-c6cc3ee149a5\") " pod="openshift-image-registry/node-ca-n8xrm"
Nov 04 01:11:18.746351 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746301    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-multus-socket-dir-parent\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746413    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-var-lib-openvswitch\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746433    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4kv5\" (UniqueName: \"kubernetes.io/projected/db2a554a-660a-4b82-8e0e-70eaac7d1136-kube-api-access-j4kv5\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746448    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f67bd09-93fb-4738-b800-36b41330d329-tmp\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746461    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-var-lib-openvswitch\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746464    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746483    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746502    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-accelerators-collector-config\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746623    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f67bd09-93fb-4738-b800-36b41330d329-tmp\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746642    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-run-systemd\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746663    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-run-systemd\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746723    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26e3ee34-ace5-4eda-a96a-6c0014a989ee-cert\") pod \"ingress-canary-25blp\" (UID: \"26e3ee34-ace5-4eda-a96a-6c0014a989ee\") " pod="openshift-ingress-canary/ingress-canary-25blp"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746750    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4f257650-743f-417e-af55-250ef2606e4a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746837    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-secret-metrics-server-client-certs\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746867    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-system-cni-dir\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746903    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-run-netns\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746908    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4f257650-743f-417e-af55-250ef2606e4a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746928    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-registration-dir\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746934    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-system-cni-dir\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746938    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-run-netns\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746945    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26e3ee34-ace5-4eda-a96a-6c0014a989ee-cert\") pod \"ingress-canary-25blp\" (UID: \"26e3ee34-ace5-4eda-a96a-6c0014a989ee\") " pod="openshift-ingress-canary/ingress-canary-25blp"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746957    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f257650-743f-417e-af55-250ef2606e4a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.746996    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-registration-dir\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747007    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/09213485-c715-420e-ab7d-c6cc3ee149a5-serviceca\") pod \"node-ca-n8xrm\" (UID: \"09213485-c715-420e-ab7d-c6cc3ee149a5\") " pod="openshift-image-registry/node-ca-n8xrm"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747035    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-wtmp\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747063    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-cnibin\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747085    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-sysctl-d\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747118    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.747127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747142    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bm95\" (UniqueName: \"kubernetes.io/projected/26e3ee34-ace5-4eda-a96a-6c0014a989ee-kube-api-access-8bm95\") pod \"ingress-canary-25blp\" (UID: \"26e3ee34-ace5-4eda-a96a-6c0014a989ee\") " pod="openshift-ingress-canary/ingress-canary-25blp"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747167    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f67bd09-93fb-4738-b800-36b41330d329-console-oauth-config\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747187    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747198    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-cnibin\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747249    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-sysctl-d\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747285    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-multus-conf-dir\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747304    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747326    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8gn5\" (UniqueName: \"kubernetes.io/projected/3f67bd09-93fb-4738-b800-36b41330d329-kube-api-access-r8gn5\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747354    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b12672cc-5caf-4cce-90b1-babce76c4007-tmp\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747337    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-multus-conf-dir\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747379    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-console-config\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747393    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747403    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-lib-modules\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747432    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-run-openvswitch\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747453    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-run-ovn-kubernetes\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747478    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-cni-bin\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747485    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-run-openvswitch\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747454    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b12672cc-5caf-4cce-90b1-babce76c4007-tmp\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747504    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-systemd\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747489    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-lib-modules\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747524    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-cni-bin\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747528    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-run-ovn-kubernetes\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747545    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-systemd\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747582    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-textfile\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747625    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/09213485-c715-420e-ab7d-c6cc3ee149a5-serviceca\") pod \"node-ca-n8xrm\" (UID: \"09213485-c715-420e-ab7d-c6cc3ee149a5\") " pod="openshift-image-registry/node-ca-n8xrm"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747623    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db2a554a-660a-4b82-8e0e-70eaac7d1136-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747680    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/db2a554a-660a-4b82-8e0e-70eaac7d1136-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747706    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-client-ca-bundle\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747686    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-textfile\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747741    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/081d2b6e-a762-4015-8a75-a43b0f6c9e66-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-mqzrv\" (UID: \"081d2b6e-a762-4015-8a75-a43b0f6c9e66\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747767    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r69h\" (UniqueName: \"kubernetes.io/projected/081d2b6e-a762-4015-8a75-a43b0f6c9e66-kube-api-access-5r69h\") pod \"openshift-state-metrics-7bd7489957-mqzrv\" (UID: \"081d2b6e-a762-4015-8a75-a43b0f6c9e66\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747791    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-web-config\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747817    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-cnibin\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747842    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-run-netns\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747884    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-cnibin\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747883    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-tuning-conf-dir\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747901    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-run-netns\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747920    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f23f719-7430-4b54-9204-13d0c5bebf96-metrics-client-ca\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747937    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-tuning-conf-dir\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:11:18.747989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.747943    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/db2a554a-660a-4b82-8e0e-70eaac7d1136-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748024    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjkw7\" (UniqueName: \"kubernetes.io/projected/4f257650-743f-417e-af55-250ef2606e4a-kube-api-access-cjkw7\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748045    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-kubelet\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748060    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-modprobe-d\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748080    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-run\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748144    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-kubelet\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748137    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-hostroot\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748194    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-modprobe-d\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748179    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-run\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748208    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-run-multus-certs\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748224    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-hostroot\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748235    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-device-dir\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748263    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea-metrics-tls\") pod \"dns-default-xlwwn\" (UID: \"4a5b0ed1-dd30-4117-9cd0-e8140080e8ea\") " pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748295    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-run-multus-certs\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748302    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-sys-fs\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748311    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-device-dir\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748333    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-cni-netd\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748352    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-sys-fs\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748360    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f257650-743f-417e-af55-250ef2606e4a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748379    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-cni-netd\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748383    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b12672cc-5caf-4cce-90b1-babce76c4007-console-serving-cert\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748415    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-var-lib-kubelet\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748443    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-oauth-config\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748465    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-console-config\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748481    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-trusted-ca-bundle\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748504    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbs8l\" (UniqueName: \"kubernetes.io/projected/b12672cc-5caf-4cce-90b1-babce76c4007-kube-api-access-kbs8l\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748520    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-sysconfig\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748523    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-var-lib-kubelet\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748545    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db2a554a-660a-4b82-8e0e-70eaac7d1136-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748563    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp4rk\" (UniqueName: \"kubernetes.io/projected/d6cefe39-1545-44f8-a04c-d2dc001be4a4-kube-api-access-gp4rk\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748579    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b12672cc-5caf-4cce-90b1-babce76c4007-console-oauth-config\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748592    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-sysconfig\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748598    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-serving-cert\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748711    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-trusted-ca-bundle\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748745    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-sysctl-conf\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748783    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748817    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-run-ovn\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748832    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4489ab7f-24b7-4845-aa8c-8344a0bbe5a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-6d4ft\" (UID: \"4489ab7f-24b7-4845-aa8c-8344a0bbe5a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d4ft"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748853    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748867    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-run-ovn\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748876    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-oauth-serving-cert\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748901    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-sysctl-conf\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748913    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-var-lib-cni-multus\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.748955    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea-tmp-dir\") pod \"dns-default-xlwwn\" (UID: \"4a5b0ed1-dd30-4117-9cd0-e8140080e8ea\") " pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:11:18.749029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.749023    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-var-lib-cni-multus\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.749083    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxgrv\" (UniqueName: \"kubernetes.io/projected/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea-kube-api-access-hxgrv\") pod \"dns-default-xlwwn\" (UID: \"4a5b0ed1-dd30-4117-9cd0-e8140080e8ea\") " pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.749097    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea-tmp-dir\") pod \"dns-default-xlwwn\" (UID: \"4a5b0ed1-dd30-4117-9cd0-e8140080e8ea\") " pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.749111    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/39954ddf-ace6-4e62-a9b4-5d12a77b202c-crio-socket\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.749159    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39954ddf-ace6-4e62-a9b4-5d12a77b202c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.749190    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lp9w\" (UniqueName: \"kubernetes.io/projected/39954ddf-ace6-4e62-a9b4-5d12a77b202c-kube-api-access-5lp9w\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.749225    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-metrics-server-audit-profiles\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.749292    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/39954ddf-ace6-4e62-a9b4-5d12a77b202c-data-volume\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.749327    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-sys\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.749401    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-sys\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.749414    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/39954ddf-ace6-4e62-a9b4-5d12a77b202c-data-volume\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.749449    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f23f719-7430-4b54-9204-13d0c5bebf96-sys\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.749468    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f23f719-7430-4b54-9204-13d0c5bebf96-root\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.749862    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-systemd-units\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.749886    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-run-k8s-cni-cncf-io\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.749912    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-secret-metrics-server-tls\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.749944    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-systemd-units\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.749953    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-run-k8s-cni-cncf-io\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750009    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750047    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-config\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750069    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-slash\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750089    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-kubernetes\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750146    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51c03abc-b77b-4b72-a707-293e13734fae-host-slash\") pod \"ovnkube-node-4glcp\" (UID: \"51c03abc-b77b-4b72-a707-293e13734fae\") " pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750199    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-etc-kubernetes\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750213    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39954ddf-ace6-4e62-a9b4-5d12a77b202c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750271    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750305    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-service-ca\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750332    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c5a2182-4c90-4ceb-b983-e7428f3a40be-host-slash\") pod \"iptables-alerter-jz7tt\" (UID: \"9c5a2182-4c90-4ceb-b983-e7428f3a40be\") " pod="openshift-network-operator/iptables-alerter-jz7tt"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750358    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-multus-cni-dir\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750386    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750416    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/081d2b6e-a762-4015-8a75-a43b0f6c9e66-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-mqzrv\" (UID: \"081d2b6e-a762-4015-8a75-a43b0f6c9e66\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750441    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-host\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750463    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c5a2182-4c90-4ceb-b983-e7428f3a40be-host-slash\") pod \"iptables-alerter-jz7tt\" (UID: \"9c5a2182-4c90-4ceb-b983-e7428f3a40be\") " pod="openshift-network-operator/iptables-alerter-jz7tt"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750509    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-system-cni-dir\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750539    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-multus-cni-dir\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750466    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7af658ed-1cc4-4f7d-b9c8-c0437180bb43-system-cni-dir\") pod \"multus-additional-cni-plugins-25q95\" (UID: \"7af658ed-1cc4-4f7d-b9c8-c0437180bb43\") " pod="openshift-multus/multus-additional-cni-plugins-25q95"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750602    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f67bd09-93fb-4738-b800-36b41330d329-console-serving-cert\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750624    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtpwr\" (UniqueName: \"kubernetes.io/projected/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-kube-api-access-dtpwr\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750644    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-var-lib-cni-bin\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750661    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-tls\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750677    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-service-ca\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750692    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-audit-log\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:11:18.750733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750705    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf440cad-3487-46a5-9d2d-4badf508cbe1-host\") pod \"tuned-7q5cg\" (UID: \"cf440cad-3487-46a5-9d2d-4badf508cbe1\") " pod="openshift-cluster-node-tuning-operator/tuned-7q5cg"
Nov 04 01:11:18.751933 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750794    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-audit-log\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:11:18.751933 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.750895    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4fc117ae-0111-4ce2-9676-f125a8b64be9-host-var-lib-cni-bin\") pod \"multus-h9lvw\" (UID: \"4fc117ae-0111-4ce2-9676-f125a8b64be9\") " pod="openshift-multus/multus-h9lvw"
Nov 04 01:11:18.776220 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.776191    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 04 01:11:18.776356 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.776250    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Nov 04 01:11:18.776711 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.776677    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Nov 04 01:11:18.776900 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.776881    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:11:18.776988 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.776901    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-config-volume\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.777157 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.777119    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Nov 04 01:11:18.777372 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.777355    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Nov 04 01:11:18.778559 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.777690    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-j924l\""
Nov 04 01:11:18.780290 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.779015    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Nov 04 01:11:18.780290 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.779078    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 04 01:11:18.780290 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.779015    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Nov 04 01:11:18.780290 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.779869    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 04 01:11:18.780290 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.779925    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Nov 04 01:11:18.780290 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.779935    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ldpj7\""
Nov 04 01:11:18.780290 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.779990    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Nov 04 01:11:18.780290 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.779873    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 04 01:11:18.780290 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.780078    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 04 01:11:18.780290 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.780089    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gg5mw\""
Nov 04 01:11:18.780290 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.780132    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 04 01:11:18.780290 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.780224    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-rqkm5\""
Nov 04 01:11:18.780290 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.780218    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.780326    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zgtmx\""
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.780342    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.780392    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.780412    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.780437    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.780465    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qr45v\""
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.780493    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.780520    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.780577    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.780616    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.780628    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.780578    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.780673    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.780726    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1jd3hsdj8to1g\""
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.780741    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.780832    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.780895    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.780899    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.780986    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.781000    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.781015    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.781068    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jfrvw\""
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.781109    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f67bd09-93fb-4738-b800-36b41330d329-console-serving-cert\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.781132    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Nov 04 01:11:18.781126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.781140    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Nov 04 01:11:18.782200 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.781159    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.782200 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.781168    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Nov 04 01:11:18.782200 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.781209    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Nov 04 01:11:18.782200 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.781219    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Nov 04 01:11:18.782200 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.781238    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-tls\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:11:18.782200 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.781312    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cvdqx\""
Nov 04 01:11:18.782200 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.781310    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-service-ca\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:11:18.782200 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.781396    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.782200 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.781444    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-service-ca\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:18.782200 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.781474    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.782200 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.781533    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39954ddf-ace6-4e62-a9b4-5d12a77b202c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:11:18.782200 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.781610    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-oauth-serving-cert\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:18.782200 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.781657    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-secret-metrics-server-tls\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:11:18.782200 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.781807    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39954ddf-ace6-4e62-a9b4-5d12a77b202c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:11:18.782200 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.781414    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/081d2b6e-a762-4015-8a75-a43b0f6c9e66-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-mqzrv\" (UID: \"081d2b6e-a762-4015-8a75-a43b0f6c9e66\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"
Nov 04 01:11:18.782831 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.782812    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-config\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:18.786133 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.786113    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/081d2b6e-a762-4015-8a75-a43b0f6c9e66-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-mqzrv\" (UID: \"081d2b6e-a762-4015-8a75-a43b0f6c9e66\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"
Nov 04 01:11:18.786218 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.786118    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-oauth-serving-cert\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:18.786287 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.786225    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-service-ca\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:18.786287 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.786261    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea-config-volume\") pod \"dns-default-xlwwn\" (UID: \"4a5b0ed1-dd30-4117-9cd0-e8140080e8ea\") " pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:11:18.786362 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.786264    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.786406 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.786391    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-oauth-serving-cert\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:11:18.787378 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.787359    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f257650-743f-417e-af55-250ef2606e4a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.787449 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.787377    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f67bd09-93fb-4738-b800-36b41330d329-console-oauth-config\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:11:18.787449 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.787407    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.787449 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.787431    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-secret-metrics-server-client-certs\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:11:18.787539 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.787452    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-accelerators-collector-config\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:11:18.787888 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.787872    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-console-config\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:11:18.788080 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.788063    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-web-config\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.788151 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.788066    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/081d2b6e-a762-4015-8a75-a43b0f6c9e66-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-mqzrv\" (UID: \"081d2b6e-a762-4015-8a75-a43b0f6c9e66\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"
Nov 04 01:11:18.788151 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.788068    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/db2a554a-660a-4b82-8e0e-70eaac7d1136-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:11:18.788151 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.788084    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db2a554a-660a-4b82-8e0e-70eaac7d1136-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:11:18.788151 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.788098    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-client-ca-bundle\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:11:18.788321 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.788234    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f23f719-7430-4b54-9204-13d0c5bebf96-metrics-client-ca\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:11:18.788321 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.788245    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/db2a554a-660a-4b82-8e0e-70eaac7d1136-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:11:18.789645 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.789529    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b12672cc-5caf-4cce-90b1-babce76c4007-console-oauth-config\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:18.789645 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.789539    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-serving-cert\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:18.789645 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.789588    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea-metrics-tls\") pod \"dns-default-xlwwn\" (UID: \"4a5b0ed1-dd30-4117-9cd0-e8140080e8ea\") " pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:11:18.789645 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.789600    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f257650-743f-417e-af55-250ef2606e4a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.789645 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.789590    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b12672cc-5caf-4cce-90b1-babce76c4007-console-serving-cert\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:18.789645 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.789620    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db2a554a-660a-4b82-8e0e-70eaac7d1136-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:11:18.789645 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.789637    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-console-config\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:18.789899 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.789669    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-oauth-config\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:18.789899 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.789668    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-metrics-server-audit-profiles\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:11:18.790923 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.790908    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:11:18.828686 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.828659    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Nov 04 01:11:18.828856 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.828833    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Nov 04 01:11:18.829130 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.829111    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-trusted-ca-bundle\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:18.829265 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.829246    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2chjr\" (UniqueName: \"kubernetes.io/projected/09213485-c715-420e-ab7d-c6cc3ee149a5-kube-api-access-2chjr\") pod \"node-ca-n8xrm\" (UID: \"09213485-c715-420e-ab7d-c6cc3ee149a5\") " pod="openshift-image-registry/node-ca-n8xrm"
Nov 04 01:11:18.829628 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.829607    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckw42\" (UniqueName: \"kubernetes.io/projected/1f23f719-7430-4b54-9204-13d0c5bebf96-kube-api-access-ckw42\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:11:18.829693 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.829605    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8gn5\" (UniqueName: \"kubernetes.io/projected/3f67bd09-93fb-4738-b800-36b41330d329-kube-api-access-r8gn5\") pod \"console-bd6bc57c4-p8hhs\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") " pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:11:18.829743 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.829695    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bm95\" (UniqueName: \"kubernetes.io/projected/26e3ee34-ace5-4eda-a96a-6c0014a989ee-kube-api-access-8bm95\") pod \"ingress-canary-25blp\" (UID: \"26e3ee34-ace5-4eda-a96a-6c0014a989ee\") " pod="openshift-ingress-canary/ingress-canary-25blp"
Nov 04 01:11:18.829743 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.829708    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4kv5\" (UniqueName: \"kubernetes.io/projected/db2a554a-660a-4b82-8e0e-70eaac7d1136-kube-api-access-j4kv5\") pod \"kube-state-metrics-5dc8d7d89b-lhm6f\" (UID: \"db2a554a-660a-4b82-8e0e-70eaac7d1136\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lhm6f"
Nov 04 01:11:18.829948 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.829930    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjkw7\" (UniqueName: \"kubernetes.io/projected/4f257650-743f-417e-af55-250ef2606e4a-kube-api-access-cjkw7\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.830227 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.830206    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lp9w\" (UniqueName: \"kubernetes.io/projected/39954ddf-ace6-4e62-a9b4-5d12a77b202c-kube-api-access-5lp9w\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:11:18.830318 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.830297    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxgrv\" (UniqueName: \"kubernetes.io/projected/4a5b0ed1-dd30-4117-9cd0-e8140080e8ea-kube-api-access-hxgrv\") pod \"dns-default-xlwwn\" (UID: \"4a5b0ed1-dd30-4117-9cd0-e8140080e8ea\") " pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:11:18.830361 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.830305    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtpwr\" (UniqueName: \"kubernetes.io/projected/7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe-kube-api-access-dtpwr\") pod \"metrics-server-77d5fd7b89-6zr4t\" (UID: \"7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe\") " pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:11:18.830406 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.830377    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbs8l\" (UniqueName: \"kubernetes.io/projected/b12672cc-5caf-4cce-90b1-babce76c4007-kube-api-access-kbs8l\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:18.830406 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.830390    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp4rk\" (UniqueName: \"kubernetes.io/projected/d6cefe39-1545-44f8-a04c-d2dc001be4a4-kube-api-access-gp4rk\") pod \"console-865f8db98-82tkl\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") " pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:18.830472 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.830456    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r69h\" (UniqueName: \"kubernetes.io/projected/081d2b6e-a762-4015-8a75-a43b0f6c9e66-kube-api-access-5r69h\") pod \"openshift-state-metrics-7bd7489957-mqzrv\" (UID: \"081d2b6e-a762-4015-8a75-a43b0f6c9e66\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-mqzrv"
Nov 04 01:11:18.836605 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.836579    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f257650-743f-417e-af55-250ef2606e4a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:18.839801 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.839785    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-trusted-ca-bundle\") pod \"console-5fd47659d6-bl52s\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") " pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:18.851254 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.851229    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/39954ddf-ace6-4e62-a9b4-5d12a77b202c-crio-socket\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:11:18.851326 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.851259    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f23f719-7430-4b54-9204-13d0c5bebf96-sys\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:11:18.851326 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.851274    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f23f719-7430-4b54-9204-13d0c5bebf96-root\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:11:18.851415 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.851309    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09213485-c715-420e-ab7d-c6cc3ee149a5-host\") pod \"node-ca-n8xrm\" (UID: \"09213485-c715-420e-ab7d-c6cc3ee149a5\") " pod="openshift-image-registry/node-ca-n8xrm"
Nov 04 01:11:18.851415 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.851352    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/39954ddf-ace6-4e62-a9b4-5d12a77b202c-crio-socket\") pod \"insights-runtime-extractor-mmvnr\" (UID: \"39954ddf-ace6-4e62-a9b4-5d12a77b202c\") " pod="openshift-insights/insights-runtime-extractor-mmvnr"
Nov 04 01:11:18.851415 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.851364    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-wtmp\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:11:18.851415 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.851354    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f23f719-7430-4b54-9204-13d0c5bebf96-sys\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:11:18.851415 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.851377    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f23f719-7430-4b54-9204-13d0c5bebf96-root\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:11:18.851415 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.851389    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09213485-c715-420e-ab7d-c6cc3ee149a5-host\") pod \"node-ca-n8xrm\" (UID: \"09213485-c715-420e-ab7d-c6cc3ee149a5\") " pod="openshift-image-registry/node-ca-n8xrm"
Nov 04 01:11:18.851583 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:18.851466    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f23f719-7430-4b54-9204-13d0c5bebf96-node-exporter-wtmp\") pod \"node-exporter-lc7jc\" (UID: \"1f23f719-7430-4b54-9204-13d0c5bebf96\") " pod="openshift-monitoring/node-exporter-lc7jc"
Nov 04 01:11:19.293855 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:19.293827    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:11:19.538791 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:19.538747    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bd6bc57c4-p8hhs"]
Nov 04 01:11:20.858951 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:20.858913    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xlwwn"
Nov 04 01:11:21.113369 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:21.113285    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:11:21.463897 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:21.463828    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:22.317836 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:22.317804    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:22.318314 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:22.318097    5640 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 01:11:23.094070 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:23.094030    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:27.423946 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:27.423842    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:33.098734 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:33.098707    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:33.102307 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:33.102288    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:11:33.593127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:33.593099    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-77d5fd7b89-6zr4t"
Nov 04 01:11:38.062773 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:38.062738    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4glcp"
Nov 04 01:11:41.141044 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:11:41.141011    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:11:42.569421 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:42.569380    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 04 01:11:42.569836 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:42.569707    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="alertmanager" containerID="cri-o://2dffe933039fd88de56eb78d51e1b9cf76d47096c9e9d7f4238ce8fdc15fa7b4" gracePeriod=120
Nov 04 01:11:42.569836 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:42.569774    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="kube-rbac-proxy-metric" containerID="cri-o://6721348019b74216cc99c9d8aecd8a09ed8970259d1b5e797547efcb4ae335d0" gracePeriod=120
Nov 04 01:11:42.569953 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:42.569830    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="prom-label-proxy" containerID="cri-o://fede5214c3886c74608da76e61076add08da34dcab51c2eee9d5cccabccf3ed7" gracePeriod=120
Nov 04 01:11:42.569953 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:42.569877    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="config-reloader" containerID="cri-o://695aa10c2c46cc0035c9c32d38c80b6479389ca53db58a80cb8691fd7fb0823b" gracePeriod=120
Nov 04 01:11:42.570097 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:42.569839    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="kube-rbac-proxy-web" containerID="cri-o://39b27c8dc348a784ec5d3b007276eb28af5a7d6c0966ecc8014d476614278902" gracePeriod=120
Nov 04 01:11:42.570097 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:42.569850    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="kube-rbac-proxy" containerID="cri-o://221768b02f2cc88f8efc79f57bf16ef5033739aa745b1ec48e30bb25566223ed" gracePeriod=120
Nov 04 01:11:42.706002 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:42.705958    5640 generic.go:356] "Generic (PLEG): container finished" podID="4f257650-743f-417e-af55-250ef2606e4a" containerID="fede5214c3886c74608da76e61076add08da34dcab51c2eee9d5cccabccf3ed7" exitCode=0
Nov 04 01:11:42.706002 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:42.705997    5640 generic.go:356] "Generic (PLEG): container finished" podID="4f257650-743f-417e-af55-250ef2606e4a" containerID="6721348019b74216cc99c9d8aecd8a09ed8970259d1b5e797547efcb4ae335d0" exitCode=0
Nov 04 01:11:42.706002 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:42.706005    5640 generic.go:356] "Generic (PLEG): container finished" podID="4f257650-743f-417e-af55-250ef2606e4a" containerID="221768b02f2cc88f8efc79f57bf16ef5033739aa745b1ec48e30bb25566223ed" exitCode=0
Nov 04 01:11:42.706002 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:42.706011    5640 generic.go:356] "Generic (PLEG): container finished" podID="4f257650-743f-417e-af55-250ef2606e4a" containerID="695aa10c2c46cc0035c9c32d38c80b6479389ca53db58a80cb8691fd7fb0823b" exitCode=0
Nov 04 01:11:42.706235 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:42.706006    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f257650-743f-417e-af55-250ef2606e4a","Type":"ContainerDied","Data":"fede5214c3886c74608da76e61076add08da34dcab51c2eee9d5cccabccf3ed7"}
Nov 04 01:11:42.706235 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:42.706069    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f257650-743f-417e-af55-250ef2606e4a","Type":"ContainerDied","Data":"6721348019b74216cc99c9d8aecd8a09ed8970259d1b5e797547efcb4ae335d0"}
Nov 04 01:11:42.706235 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:42.706017    5640 generic.go:356] "Generic (PLEG): container finished" podID="4f257650-743f-417e-af55-250ef2606e4a" containerID="2dffe933039fd88de56eb78d51e1b9cf76d47096c9e9d7f4238ce8fdc15fa7b4" exitCode=0
Nov 04 01:11:42.706235 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:42.706095    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f257650-743f-417e-af55-250ef2606e4a","Type":"ContainerDied","Data":"221768b02f2cc88f8efc79f57bf16ef5033739aa745b1ec48e30bb25566223ed"}
Nov 04 01:11:42.706235 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:42.706122    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f257650-743f-417e-af55-250ef2606e4a","Type":"ContainerDied","Data":"695aa10c2c46cc0035c9c32d38c80b6479389ca53db58a80cb8691fd7fb0823b"}
Nov 04 01:11:42.706235 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:42.706145    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f257650-743f-417e-af55-250ef2606e4a","Type":"ContainerDied","Data":"2dffe933039fd88de56eb78d51e1b9cf76d47096c9e9d7f4238ce8fdc15fa7b4"}
Nov 04 01:11:43.652540 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:43.652508    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-865f8db98-82tkl" podUID="d6cefe39-1545-44f8-a04c-d2dc001be4a4" containerName="console" containerID="cri-o://528314dac9efd9941794047283734dfa4b8ca89009db36907e4c26242241e60f" gracePeriod=15
Nov 04 01:11:43.713091 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:43.713065    5640 generic.go:356] "Generic (PLEG): container finished" podID="4f257650-743f-417e-af55-250ef2606e4a" containerID="39b27c8dc348a784ec5d3b007276eb28af5a7d6c0966ecc8014d476614278902" exitCode=0
Nov 04 01:11:43.713224 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:43.713134    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f257650-743f-417e-af55-250ef2606e4a","Type":"ContainerDied","Data":"39b27c8dc348a784ec5d3b007276eb28af5a7d6c0966ecc8014d476614278902"}
Nov 04 01:11:43.898234 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:43.898177    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:43.924544 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:43.924515    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:44.059747 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.059709    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-config-volume\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-config-volume\") pod \"4f257650-743f-417e-af55-250ef2606e4a\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") "
Nov 04 01:11:44.059747 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.059751    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-service-ca\") pod \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") "
Nov 04 01:11:44.060029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.059781    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4f257650-743f-417e-af55-250ef2606e4a-tls-assets\" (UniqueName: \"kubernetes.io/projected/4f257650-743f-417e-af55-250ef2606e4a-tls-assets\") pod \"4f257650-743f-417e-af55-250ef2606e4a\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") "
Nov 04 01:11:44.060029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.059808    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f257650-743f-417e-af55-250ef2606e4a-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4f257650-743f-417e-af55-250ef2606e4a-alertmanager-main-db\") pod \"4f257650-743f-417e-af55-250ef2606e4a\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") "
Nov 04 01:11:44.060029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.059842    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-serving-cert\") pod \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") "
Nov 04 01:11:44.060029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.059874    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-oauth-serving-cert\") pod \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") "
Nov 04 01:11:44.060239 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.060152    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-cluster-tls-config\") pod \"4f257650-743f-417e-af55-250ef2606e4a\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") "
Nov 04 01:11:44.060239 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.060202    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f257650-743f-417e-af55-250ef2606e4a-config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f257650-743f-417e-af55-250ef2606e4a-config-out\") pod \"4f257650-743f-417e-af55-250ef2606e4a\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") "
Nov 04 01:11:44.060336 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.060242    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy\") pod \"4f257650-743f-417e-af55-250ef2606e4a\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") "
Nov 04 01:11:44.060336 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.060251    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f257650-743f-417e-af55-250ef2606e4a-alertmanager-main-db" pod "4f257650-743f-417e-af55-250ef2606e4a" (UID: "4f257650-743f-417e-af55-250ef2606e4a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:11:44.060336 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.060275    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4f257650-743f-417e-af55-250ef2606e4a-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f257650-743f-417e-af55-250ef2606e4a-metrics-client-ca\") pod \"4f257650-743f-417e-af55-250ef2606e4a\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") "
Nov 04 01:11:44.060336 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.060295    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-oauth-serving-cert" pod "d6cefe39-1545-44f8-a04c-d2dc001be4a4" (UID: "d6cefe39-1545-44f8-a04c-d2dc001be4a4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:11:44.060336 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.060309    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy-web\") pod \"4f257650-743f-417e-af55-250ef2606e4a\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") "
Nov 04 01:11:44.060587 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.060343    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d6cefe39-1545-44f8-a04c-d2dc001be4a4-kube-api-access-gp4rk\" (UniqueName: \"kubernetes.io/projected/d6cefe39-1545-44f8-a04c-d2dc001be4a4-kube-api-access-gp4rk\") pod \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") "
Nov 04 01:11:44.060587 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.060347    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-service-ca" pod "d6cefe39-1545-44f8-a04c-d2dc001be4a4" (UID: "d6cefe39-1545-44f8-a04c-d2dc001be4a4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:11:44.060587 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.060386    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-web-config\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-web-config\") pod \"4f257650-743f-417e-af55-250ef2606e4a\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") "
Nov 04 01:11:44.060587 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.060414    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-trusted-ca-bundle\") pod \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") "
Nov 04 01:11:44.060587 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.060452    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4f257650-743f-417e-af55-250ef2606e4a\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") "
Nov 04 01:11:44.060587 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.060496    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-oauth-config\") pod \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") "
Nov 04 01:11:44.060587 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.060524    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4f257650-743f-417e-af55-250ef2606e4a-kube-api-access-cjkw7\" (UniqueName: \"kubernetes.io/projected/4f257650-743f-417e-af55-250ef2606e4a-kube-api-access-cjkw7\") pod \"4f257650-743f-417e-af55-250ef2606e4a\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") "
Nov 04 01:11:44.060587 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.060567    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6cefe39-1545-44f8-a04c-d2dc001be4a4-tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6cefe39-1545-44f8-a04c-d2dc001be4a4-tmp\") pod \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") "
Nov 04 01:11:44.061014 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.060603    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4f257650-743f-417e-af55-250ef2606e4a-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f257650-743f-417e-af55-250ef2606e4a-alertmanager-trusted-ca-bundle\") pod \"4f257650-743f-417e-af55-250ef2606e4a\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") "
Nov 04 01:11:44.061014 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.060632    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-config\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-config\") pod \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\" (UID: \"d6cefe39-1545-44f8-a04c-d2dc001be4a4\") "
Nov 04 01:11:44.061014 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.060670    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-main-tls\") pod \"4f257650-743f-417e-af55-250ef2606e4a\" (UID: \"4f257650-743f-417e-af55-250ef2606e4a\") "
Nov 04 01:11:44.061014 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.060775    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f257650-743f-417e-af55-250ef2606e4a-metrics-client-ca" pod "4f257650-743f-417e-af55-250ef2606e4a" (UID: "4f257650-743f-417e-af55-250ef2606e4a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:11:44.061014 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.060952    5640 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-oauth-serving-cert\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:44.061014 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.061000    5640 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f257650-743f-417e-af55-250ef2606e4a-metrics-client-ca\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:44.061337 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.061018    5640 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-service-ca\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:44.061337 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.061035    5640 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4f257650-743f-417e-af55-250ef2606e4a-alertmanager-main-db\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:44.062005 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.061731    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6cefe39-1545-44f8-a04c-d2dc001be4a4-tmp" pod "d6cefe39-1545-44f8-a04c-d2dc001be4a4" (UID: "d6cefe39-1545-44f8-a04c-d2dc001be4a4"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:11:44.062670 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.062649    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f257650-743f-417e-af55-250ef2606e4a-alertmanager-trusted-ca-bundle" pod "4f257650-743f-417e-af55-250ef2606e4a" (UID: "4f257650-743f-417e-af55-250ef2606e4a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:11:44.063316 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.063286    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-config" pod "d6cefe39-1545-44f8-a04c-d2dc001be4a4" (UID: "d6cefe39-1545-44f8-a04c-d2dc001be4a4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:11:44.063316 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.063304    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-trusted-ca-bundle" pod "d6cefe39-1545-44f8-a04c-d2dc001be4a4" (UID: "d6cefe39-1545-44f8-a04c-d2dc001be4a4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:11:44.063459 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.063336    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f257650-743f-417e-af55-250ef2606e4a-config-out" pod "4f257650-743f-417e-af55-250ef2606e4a" (UID: "4f257650-743f-417e-af55-250ef2606e4a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:11:44.063459 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.063351    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f257650-743f-417e-af55-250ef2606e4a-tls-assets" pod "4f257650-743f-417e-af55-250ef2606e4a" (UID: "4f257650-743f-417e-af55-250ef2606e4a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:11:44.063572 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.063508    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-serving-cert" pod "d6cefe39-1545-44f8-a04c-d2dc001be4a4" (UID: "d6cefe39-1545-44f8-a04c-d2dc001be4a4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:11:44.063572 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.063542    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-config-volume" pod "4f257650-743f-417e-af55-250ef2606e4a" (UID: "4f257650-743f-417e-af55-250ef2606e4a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:11:44.065098 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.065068    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy-metric" pod "4f257650-743f-417e-af55-250ef2606e4a" (UID: "4f257650-743f-417e-af55-250ef2606e4a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:11:44.065195 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.065140    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6cefe39-1545-44f8-a04c-d2dc001be4a4-kube-api-access-gp4rk" pod "d6cefe39-1545-44f8-a04c-d2dc001be4a4" (UID: "d6cefe39-1545-44f8-a04c-d2dc001be4a4"). InnerVolumeSpecName "kube-api-access-gp4rk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:11:44.065195 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.065150    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f257650-743f-417e-af55-250ef2606e4a-kube-api-access-cjkw7" pod "4f257650-743f-417e-af55-250ef2606e4a" (UID: "4f257650-743f-417e-af55-250ef2606e4a"). InnerVolumeSpecName "kube-api-access-cjkw7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:11:44.065317 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.065281    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy" pod "4f257650-743f-417e-af55-250ef2606e4a" (UID: "4f257650-743f-417e-af55-250ef2606e4a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:11:44.065317 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.065278    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-oauth-config" pod "d6cefe39-1545-44f8-a04c-d2dc001be4a4" (UID: "d6cefe39-1545-44f8-a04c-d2dc001be4a4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:11:44.065568 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.065548    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-main-tls" pod "4f257650-743f-417e-af55-250ef2606e4a" (UID: "4f257650-743f-417e-af55-250ef2606e4a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:11:44.065664 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.065640    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy-web" pod "4f257650-743f-417e-af55-250ef2606e4a" (UID: "4f257650-743f-417e-af55-250ef2606e4a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:11:44.068332 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.068310    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-cluster-tls-config" pod "4f257650-743f-417e-af55-250ef2606e4a" (UID: "4f257650-743f-417e-af55-250ef2606e4a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:11:44.075142 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.075115    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-web-config" pod "4f257650-743f-417e-af55-250ef2606e4a" (UID: "4f257650-743f-417e-af55-250ef2606e4a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:11:44.162040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.161939    5640 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-web-config\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:44.162040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.161964    5640 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-trusted-ca-bundle\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:44.162040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.161992    5640 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:44.162040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.162003    5640 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-oauth-config\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:44.162040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.162013    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjkw7\" (UniqueName: \"kubernetes.io/projected/4f257650-743f-417e-af55-250ef2606e4a-kube-api-access-cjkw7\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:44.162040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.162023    5640 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6cefe39-1545-44f8-a04c-d2dc001be4a4-tmp\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:44.162040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.162032    5640 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f257650-743f-417e-af55-250ef2606e4a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:44.162040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.162040    5640 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-config\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:44.162375 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.162048    5640 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-main-tls\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:44.162375 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.162058    5640 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-config-volume\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:44.162375 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.162068    5640 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f257650-743f-417e-af55-250ef2606e4a-tls-assets\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:44.162375 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.162076    5640 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6cefe39-1545-44f8-a04c-d2dc001be4a4-console-serving-cert\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:44.162375 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.162084    5640 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-cluster-tls-config\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:44.162375 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.162092    5640 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f257650-743f-417e-af55-250ef2606e4a-config-out\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:44.162375 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.162101    5640 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:44.162375 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.162112    5640 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f257650-743f-417e-af55-250ef2606e4a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:44.162375 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.162121    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp4rk\" (UniqueName: \"kubernetes.io/projected/d6cefe39-1545-44f8-a04c-d2dc001be4a4-kube-api-access-gp4rk\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:44.641227 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.641167    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-bd6bc57c4-p8hhs" podUID="3f67bd09-93fb-4738-b800-36b41330d329" containerName="console" containerID="cri-o://98265d5211a8a4baae001fa0653a94d3796e7a5ee12735cdefdda5e10c3f38d2" gracePeriod=15
Nov 04 01:11:44.650694 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.650666    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-f58ff4764-wcwdt"]
Nov 04 01:11:44.650963 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.650950    5640 cpu_manager.go:414] "containerMap: removing container" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="kube-rbac-proxy-metric"
Nov 04 01:11:44.650963 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.650996    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="kube-rbac-proxy-metric"
Nov 04 01:11:44.650963 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.651017    5640 cpu_manager.go:414] "containerMap: removing container" podUID="d6cefe39-1545-44f8-a04c-d2dc001be4a4" containerName="console"
Nov 04 01:11:44.650963 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.651026    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d6cefe39-1545-44f8-a04c-d2dc001be4a4" containerName="console"
Nov 04 01:11:44.651183 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.651036    5640 cpu_manager.go:414] "containerMap: removing container" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="kube-rbac-proxy-web"
Nov 04 01:11:44.651183 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.651044    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="kube-rbac-proxy-web"
Nov 04 01:11:44.651183 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.651057    5640 cpu_manager.go:414] "containerMap: removing container" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="alertmanager"
Nov 04 01:11:44.651183 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.651064    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="alertmanager"
Nov 04 01:11:44.651183 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.651074    5640 cpu_manager.go:414] "containerMap: removing container" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="prom-label-proxy"
Nov 04 01:11:44.651183 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.651079    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="prom-label-proxy"
Nov 04 01:11:44.651183 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.651087    5640 cpu_manager.go:414] "containerMap: removing container" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="config-reloader"
Nov 04 01:11:44.651183 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.651091    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="config-reloader"
Nov 04 01:11:44.651183 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.651100    5640 cpu_manager.go:414] "containerMap: removing container" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="kube-rbac-proxy"
Nov 04 01:11:44.651183 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.651104    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="kube-rbac-proxy"
Nov 04 01:11:44.651183 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.651115    5640 cpu_manager.go:414] "containerMap: removing container" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="init-config-reloader"
Nov 04 01:11:44.651183 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.651120    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="init-config-reloader"
Nov 04 01:11:44.651183 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.651159    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="alertmanager"
Nov 04 01:11:44.651183 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.651167    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="prom-label-proxy"
Nov 04 01:11:44.651183 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.651173    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="config-reloader"
Nov 04 01:11:44.651183 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.651179    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="kube-rbac-proxy"
Nov 04 01:11:44.651183 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.651185    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="init-config-reloader"
Nov 04 01:11:44.651183 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.651191    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="kube-rbac-proxy-metric"
Nov 04 01:11:44.651722 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.651197    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="d6cefe39-1545-44f8-a04c-d2dc001be4a4" containerName="console"
Nov 04 01:11:44.651722 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.651202    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f257650-743f-417e-af55-250ef2606e4a" containerName="kube-rbac-proxy-web"
Nov 04 01:11:44.653120 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.653103    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:44.710149 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.710123    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f58ff4764-wcwdt"]
Nov 04 01:11:44.722217 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.722182    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f257650-743f-417e-af55-250ef2606e4a","Type":"ContainerDied","Data":"3afc624431f8a97662a03146dedd3d5bf1a2e4366d630feac4c31e8595446ef2"}
Nov 04 01:11:44.722364 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.722222    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:44.722364 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.722276    5640 scope.go:122] "RemoveContainer" containerID="fede5214c3886c74608da76e61076add08da34dcab51c2eee9d5cccabccf3ed7"
Nov 04 01:11:44.723516 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.723497    5640 generic.go:356] "Generic (PLEG): container finished" podID="d6cefe39-1545-44f8-a04c-d2dc001be4a4" containerID="528314dac9efd9941794047283734dfa4b8ca89009db36907e4c26242241e60f" exitCode=0
Nov 04 01:11:44.723573 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.723545    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-865f8db98-82tkl"
Nov 04 01:11:44.723573 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.723565    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-865f8db98-82tkl" event={"ID":"d6cefe39-1545-44f8-a04c-d2dc001be4a4","Type":"ContainerDied","Data":"528314dac9efd9941794047283734dfa4b8ca89009db36907e4c26242241e60f"}
Nov 04 01:11:44.723638 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.723593    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-865f8db98-82tkl" event={"ID":"d6cefe39-1545-44f8-a04c-d2dc001be4a4","Type":"ContainerDied","Data":"9707c16bb6a9c0396db9741abfe71eee71aedc4f00016666a8bf7e75832b17b6"}
Nov 04 01:11:44.752482 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.752460    5640 scope.go:122] "RemoveContainer" containerID="6721348019b74216cc99c9d8aecd8a09ed8970259d1b5e797547efcb4ae335d0"
Nov 04 01:11:44.759659 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.759638    5640 scope.go:122] "RemoveContainer" containerID="221768b02f2cc88f8efc79f57bf16ef5033739aa745b1ec48e30bb25566223ed"
Nov 04 01:11:44.766449 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.766426    5640 scope.go:122] "RemoveContainer" containerID="39b27c8dc348a784ec5d3b007276eb28af5a7d6c0966ecc8014d476614278902"
Nov 04 01:11:44.767196 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.767176    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8268dc1d-b09d-4c82-b950-4f95447f53cf-console-oauth-config\") pod \"console-f58ff4764-wcwdt\" (UID: \"8268dc1d-b09d-4c82-b950-4f95447f53cf\") " pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:44.767301 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.767206    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8268dc1d-b09d-4c82-b950-4f95447f53cf-trusted-ca-bundle\") pod \"console-f58ff4764-wcwdt\" (UID: \"8268dc1d-b09d-4c82-b950-4f95447f53cf\") " pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:44.767420 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.767360    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbmsf\" (UniqueName: \"kubernetes.io/projected/8268dc1d-b09d-4c82-b950-4f95447f53cf-kube-api-access-bbmsf\") pod \"console-f58ff4764-wcwdt\" (UID: \"8268dc1d-b09d-4c82-b950-4f95447f53cf\") " pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:44.767463 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.767411    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8268dc1d-b09d-4c82-b950-4f95447f53cf-service-ca\") pod \"console-f58ff4764-wcwdt\" (UID: \"8268dc1d-b09d-4c82-b950-4f95447f53cf\") " pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:44.767538 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.767515    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8268dc1d-b09d-4c82-b950-4f95447f53cf-tmp\") pod \"console-f58ff4764-wcwdt\" (UID: \"8268dc1d-b09d-4c82-b950-4f95447f53cf\") " pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:44.767580 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.767565    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8268dc1d-b09d-4c82-b950-4f95447f53cf-console-config\") pod \"console-f58ff4764-wcwdt\" (UID: \"8268dc1d-b09d-4c82-b950-4f95447f53cf\") " pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:44.767672 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.767658    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8268dc1d-b09d-4c82-b950-4f95447f53cf-console-serving-cert\") pod \"console-f58ff4764-wcwdt\" (UID: \"8268dc1d-b09d-4c82-b950-4f95447f53cf\") " pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:44.767722 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.767686    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8268dc1d-b09d-4c82-b950-4f95447f53cf-oauth-serving-cert\") pod \"console-f58ff4764-wcwdt\" (UID: \"8268dc1d-b09d-4c82-b950-4f95447f53cf\") " pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:44.775375 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.775357    5640 scope.go:122] "RemoveContainer" containerID="695aa10c2c46cc0035c9c32d38c80b6479389ca53db58a80cb8691fd7fb0823b"
Nov 04 01:11:44.782497 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.782472    5640 scope.go:122] "RemoveContainer" containerID="2dffe933039fd88de56eb78d51e1b9cf76d47096c9e9d7f4238ce8fdc15fa7b4"
Nov 04 01:11:44.791114 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.791089    5640 scope.go:122] "RemoveContainer" containerID="0fb89146deebf4e8e68877b7ad34f8913492768c82e500ad5f4ca27a85c5ee29"
Nov 04 01:11:44.798512 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.798488    5640 scope.go:122] "RemoveContainer" containerID="528314dac9efd9941794047283734dfa4b8ca89009db36907e4c26242241e60f"
Nov 04 01:11:44.806027 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.805954    5640 scope.go:122] "RemoveContainer" containerID="528314dac9efd9941794047283734dfa4b8ca89009db36907e4c26242241e60f"
Nov 04 01:11:44.806350 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:11:44.806329    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"528314dac9efd9941794047283734dfa4b8ca89009db36907e4c26242241e60f\": container with ID starting with 528314dac9efd9941794047283734dfa4b8ca89009db36907e4c26242241e60f not found: ID does not exist" containerID="528314dac9efd9941794047283734dfa4b8ca89009db36907e4c26242241e60f"
Nov 04 01:11:44.806400 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.806361    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"528314dac9efd9941794047283734dfa4b8ca89009db36907e4c26242241e60f"} err="failed to get container status \"528314dac9efd9941794047283734dfa4b8ca89009db36907e4c26242241e60f\": rpc error: code = NotFound desc = could not find container \"528314dac9efd9941794047283734dfa4b8ca89009db36907e4c26242241e60f\": container with ID starting with 528314dac9efd9941794047283734dfa4b8ca89009db36907e4c26242241e60f not found: ID does not exist"
Nov 04 01:11:44.868779 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.868729    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbmsf\" (UniqueName: \"kubernetes.io/projected/8268dc1d-b09d-4c82-b950-4f95447f53cf-kube-api-access-bbmsf\") pod \"console-f58ff4764-wcwdt\" (UID: \"8268dc1d-b09d-4c82-b950-4f95447f53cf\") " pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:44.868934 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.868791    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8268dc1d-b09d-4c82-b950-4f95447f53cf-service-ca\") pod \"console-f58ff4764-wcwdt\" (UID: \"8268dc1d-b09d-4c82-b950-4f95447f53cf\") " pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:44.868934 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.868824    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8268dc1d-b09d-4c82-b950-4f95447f53cf-tmp\") pod \"console-f58ff4764-wcwdt\" (UID: \"8268dc1d-b09d-4c82-b950-4f95447f53cf\") " pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:44.868934 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.868858    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8268dc1d-b09d-4c82-b950-4f95447f53cf-console-config\") pod \"console-f58ff4764-wcwdt\" (UID: \"8268dc1d-b09d-4c82-b950-4f95447f53cf\") " pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:44.868934 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.868893    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8268dc1d-b09d-4c82-b950-4f95447f53cf-console-serving-cert\") pod \"console-f58ff4764-wcwdt\" (UID: \"8268dc1d-b09d-4c82-b950-4f95447f53cf\") " pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:44.868934 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.868919    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8268dc1d-b09d-4c82-b950-4f95447f53cf-oauth-serving-cert\") pod \"console-f58ff4764-wcwdt\" (UID: \"8268dc1d-b09d-4c82-b950-4f95447f53cf\") " pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:44.869204 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.868999    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8268dc1d-b09d-4c82-b950-4f95447f53cf-console-oauth-config\") pod \"console-f58ff4764-wcwdt\" (UID: \"8268dc1d-b09d-4c82-b950-4f95447f53cf\") " pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:44.869204 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.869033    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8268dc1d-b09d-4c82-b950-4f95447f53cf-trusted-ca-bundle\") pod \"console-f58ff4764-wcwdt\" (UID: \"8268dc1d-b09d-4c82-b950-4f95447f53cf\") " pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:44.869366 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.869340    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8268dc1d-b09d-4c82-b950-4f95447f53cf-tmp\") pod \"console-f58ff4764-wcwdt\" (UID: \"8268dc1d-b09d-4c82-b950-4f95447f53cf\") " pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:44.869418 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.869355    5640 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 04 01:11:44.869684 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.869654    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8268dc1d-b09d-4c82-b950-4f95447f53cf-service-ca\") pod \"console-f58ff4764-wcwdt\" (UID: \"8268dc1d-b09d-4c82-b950-4f95447f53cf\") " pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:44.869814 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.869787    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8268dc1d-b09d-4c82-b950-4f95447f53cf-oauth-serving-cert\") pod \"console-f58ff4764-wcwdt\" (UID: \"8268dc1d-b09d-4c82-b950-4f95447f53cf\") " pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:44.869889 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.869795    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8268dc1d-b09d-4c82-b950-4f95447f53cf-console-config\") pod \"console-f58ff4764-wcwdt\" (UID: \"8268dc1d-b09d-4c82-b950-4f95447f53cf\") " pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:44.869945 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.869894    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8268dc1d-b09d-4c82-b950-4f95447f53cf-trusted-ca-bundle\") pod \"console-f58ff4764-wcwdt\" (UID: \"8268dc1d-b09d-4c82-b950-4f95447f53cf\") " pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:44.871774 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.871751    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8268dc1d-b09d-4c82-b950-4f95447f53cf-console-serving-cert\") pod \"console-f58ff4764-wcwdt\" (UID: \"8268dc1d-b09d-4c82-b950-4f95447f53cf\") " pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:44.871890 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.871866    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8268dc1d-b09d-4c82-b950-4f95447f53cf-console-oauth-config\") pod \"console-f58ff4764-wcwdt\" (UID: \"8268dc1d-b09d-4c82-b950-4f95447f53cf\") " pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:44.888855 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.888826    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-865f8db98-82tkl"]
Nov 04 01:11:44.892325 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.892265    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:11:44.892544 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.892524    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-865f8db98-82tkl"]
Nov 04 01:11:44.931610 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:44.931581    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbmsf\" (UniqueName: \"kubernetes.io/projected/8268dc1d-b09d-4c82-b950-4f95447f53cf-kube-api-access-bbmsf\") pod \"console-f58ff4764-wcwdt\" (UID: \"8268dc1d-b09d-4c82-b950-4f95447f53cf\") " pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:45.008917 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.008881    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 04 01:11:45.013578 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.013553    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 04 01:11:45.021182 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.021152    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:45.043148 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.043117    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 04 01:11:45.043443 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.043427    5640 cpu_manager.go:414] "containerMap: removing container" podUID="3f67bd09-93fb-4738-b800-36b41330d329" containerName="console"
Nov 04 01:11:45.043443 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.043442    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3f67bd09-93fb-4738-b800-36b41330d329" containerName="console"
Nov 04 01:11:45.043588 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.043495    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="3f67bd09-93fb-4738-b800-36b41330d329" containerName="console"
Nov 04 01:11:45.046211 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.046192    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.070699 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.070409    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-oauth-serving-cert\") pod \"3f67bd09-93fb-4738-b800-36b41330d329\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") "
Nov 04 01:11:45.070699 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.070475    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3f67bd09-93fb-4738-b800-36b41330d329-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f67bd09-93fb-4738-b800-36b41330d329-console-oauth-config\") pod \"3f67bd09-93fb-4738-b800-36b41330d329\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") "
Nov 04 01:11:45.070699 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.070511    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-console-config\" (UniqueName: \"kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-console-config\") pod \"3f67bd09-93fb-4738-b800-36b41330d329\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") "
Nov 04 01:11:45.070699 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.070553    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f67bd09-93fb-4738-b800-36b41330d329-tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f67bd09-93fb-4738-b800-36b41330d329-tmp\") pod \"3f67bd09-93fb-4738-b800-36b41330d329\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") "
Nov 04 01:11:45.070699 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.070599    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-service-ca\") pod \"3f67bd09-93fb-4738-b800-36b41330d329\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") "
Nov 04 01:11:45.070699 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.070644    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3f67bd09-93fb-4738-b800-36b41330d329-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f67bd09-93fb-4738-b800-36b41330d329-console-serving-cert\") pod \"3f67bd09-93fb-4738-b800-36b41330d329\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") "
Nov 04 01:11:45.070699 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.070673    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3f67bd09-93fb-4738-b800-36b41330d329-kube-api-access-r8gn5\" (UniqueName: \"kubernetes.io/projected/3f67bd09-93fb-4738-b800-36b41330d329-kube-api-access-r8gn5\") pod \"3f67bd09-93fb-4738-b800-36b41330d329\" (UID: \"3f67bd09-93fb-4738-b800-36b41330d329\") "
Nov 04 01:11:45.074199 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.071246    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-console-config" pod "3f67bd09-93fb-4738-b800-36b41330d329" (UID: "3f67bd09-93fb-4738-b800-36b41330d329"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:11:45.074199 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.071264    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-service-ca" pod "3f67bd09-93fb-4738-b800-36b41330d329" (UID: "3f67bd09-93fb-4738-b800-36b41330d329"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:11:45.074199 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.071422    5640 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-console-config\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:45.074199 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.071568    5640 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-service-ca\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:45.074199 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.071665    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-oauth-serving-cert" pod "3f67bd09-93fb-4738-b800-36b41330d329" (UID: "3f67bd09-93fb-4738-b800-36b41330d329"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:11:45.074199 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.073303    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f67bd09-93fb-4738-b800-36b41330d329-console-oauth-config" pod "3f67bd09-93fb-4738-b800-36b41330d329" (UID: "3f67bd09-93fb-4738-b800-36b41330d329"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:11:45.074199 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.073708    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f67bd09-93fb-4738-b800-36b41330d329-console-serving-cert" pod "3f67bd09-93fb-4738-b800-36b41330d329" (UID: "3f67bd09-93fb-4738-b800-36b41330d329"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:11:45.074199 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.073888    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f67bd09-93fb-4738-b800-36b41330d329-tmp" pod "3f67bd09-93fb-4738-b800-36b41330d329" (UID: "3f67bd09-93fb-4738-b800-36b41330d329"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:11:45.074502 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.074473    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f67bd09-93fb-4738-b800-36b41330d329-kube-api-access-r8gn5" pod "3f67bd09-93fb-4738-b800-36b41330d329" (UID: "3f67bd09-93fb-4738-b800-36b41330d329"). InnerVolumeSpecName "kube-api-access-r8gn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:11:45.100652 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.100585    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Nov 04 01:11:45.100652 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.100617    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Nov 04 01:11:45.100652 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.100646    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Nov 04 01:11:45.101162 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.100908    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jfrvw\""
Nov 04 01:11:45.101162 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.101026    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Nov 04 01:11:45.101162 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.101153    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Nov 04 01:11:45.101354 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.101182    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Nov 04 01:11:45.101354 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.101180    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Nov 04 01:11:45.101492 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.101400    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Nov 04 01:11:45.101839 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.101819    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Nov 04 01:11:45.122481 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.122451    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 04 01:11:45.172718 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.172629    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-config-volume\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.172718 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.172679    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.172951 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.172750    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.172951 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.172824    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.172951 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.172879    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.172951 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.172908    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.173135 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.172963    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lxng\" (UniqueName: \"kubernetes.io/projected/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-kube-api-access-7lxng\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.173135 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.173051    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.173135 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.173116    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.173282 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.173139    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.173282 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.173218    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-config-out\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.173282 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.173277    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.173435 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.173322    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-web-config\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.173435 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.173371    5640 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f67bd09-93fb-4738-b800-36b41330d329-tmp\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:45.173435 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.173391    5640 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f67bd09-93fb-4738-b800-36b41330d329-console-serving-cert\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:45.173435 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.173406    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8gn5\" (UniqueName: \"kubernetes.io/projected/3f67bd09-93fb-4738-b800-36b41330d329-kube-api-access-r8gn5\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:45.173435 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.173421    5640 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f67bd09-93fb-4738-b800-36b41330d329-oauth-serving-cert\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:45.173584 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.173436    5640 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f67bd09-93fb-4738-b800-36b41330d329-console-oauth-config\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:11:45.193988 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.193939    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vktnk"
Nov 04 01:11:45.273823 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.273784    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.273823 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.273826    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lxng\" (UniqueName: \"kubernetes.io/projected/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-kube-api-access-7lxng\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.274076 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.273937    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.274076 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.273996    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.274076 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.274019    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.274076 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.274043    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-config-out\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.274283 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.274078    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.274283 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.274124    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-web-config\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.274283 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.274156    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-config-volume\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.274283 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.274205    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.274283 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.274225    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.274283 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.274250    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.274566 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.274289    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.275188 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.274669    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.275575 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.275550    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.276424 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.276378    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.277807 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.277781    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.278441 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.277816    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.278441 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.278078    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.278441 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.278329    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-config-out\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.278441 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.278348    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.278441 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.278404    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.278645 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.278494    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.278706 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.278685    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-config-volume\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.279522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.279505    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-web-config\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.336690 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.336657    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lxng\" (UniqueName: \"kubernetes.io/projected/6b0c9a7e-e097-4ac1-90c9-ab5935c47d47-kube-api-access-7lxng\") pod \"alertmanager-main-0\" (UID: \"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.368536 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.368498    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 04 01:11:45.396476 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:45.396433    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8268dc1d_b09d_4c82_b950_4f95447f53cf.slice/crio-7e60853be6e13aa63186c3af1927b0a00eb174b4e801b185085f9c0c7aa467f8 WatchSource:0}: Error finding container 7e60853be6e13aa63186c3af1927b0a00eb174b4e801b185085f9c0c7aa467f8: Status 404 returned error can't find the container with id 7e60853be6e13aa63186c3af1927b0a00eb174b4e801b185085f9c0c7aa467f8
Nov 04 01:11:45.397294 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.397270    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f58ff4764-wcwdt"]
Nov 04 01:11:45.562583 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.562544    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4f257650-743f-417e-af55-250ef2606e4a" path="/var/lib/kubelet/pods/4f257650-743f-417e-af55-250ef2606e4a/volumes"
Nov 04 01:11:45.563314 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.563296    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d6cefe39-1545-44f8-a04c-d2dc001be4a4" path="/var/lib/kubelet/pods/d6cefe39-1545-44f8-a04c-d2dc001be4a4/volumes"
Nov 04 01:11:45.729456 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.729361    5640 generic.go:356] "Generic (PLEG): container finished" podID="3f67bd09-93fb-4738-b800-36b41330d329" containerID="98265d5211a8a4baae001fa0653a94d3796e7a5ee12735cdefdda5e10c3f38d2" exitCode=0
Nov 04 01:11:45.729456 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.729425    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd6bc57c4-p8hhs"
Nov 04 01:11:45.729456 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.729443    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd6bc57c4-p8hhs" event={"ID":"3f67bd09-93fb-4738-b800-36b41330d329","Type":"ContainerDied","Data":"98265d5211a8a4baae001fa0653a94d3796e7a5ee12735cdefdda5e10c3f38d2"}
Nov 04 01:11:45.730038 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.729528    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd6bc57c4-p8hhs" event={"ID":"3f67bd09-93fb-4738-b800-36b41330d329","Type":"ContainerDied","Data":"abdee1768829bac6ec5dd61ff0d0a0b8fbb57c6e96ec61f407b4e1201295daa0"}
Nov 04 01:11:45.730038 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.729561    5640 scope.go:122] "RemoveContainer" containerID="98265d5211a8a4baae001fa0653a94d3796e7a5ee12735cdefdda5e10c3f38d2"
Nov 04 01:11:45.732374 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.732349    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f58ff4764-wcwdt" event={"ID":"8268dc1d-b09d-4c82-b950-4f95447f53cf","Type":"ContainerStarted","Data":"f8ad9163903bdf6aeb5c82a2dcebd7251654a5d1a3dc8b14624b6047be587948"}
Nov 04 01:11:45.732468 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.732393    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f58ff4764-wcwdt" event={"ID":"8268dc1d-b09d-4c82-b950-4f95447f53cf","Type":"ContainerStarted","Data":"7e60853be6e13aa63186c3af1927b0a00eb174b4e801b185085f9c0c7aa467f8"}
Nov 04 01:11:45.737649 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.737629    5640 scope.go:122] "RemoveContainer" containerID="98265d5211a8a4baae001fa0653a94d3796e7a5ee12735cdefdda5e10c3f38d2"
Nov 04 01:11:45.737922 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:11:45.737903    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98265d5211a8a4baae001fa0653a94d3796e7a5ee12735cdefdda5e10c3f38d2\": container with ID starting with 98265d5211a8a4baae001fa0653a94d3796e7a5ee12735cdefdda5e10c3f38d2 not found: ID does not exist" containerID="98265d5211a8a4baae001fa0653a94d3796e7a5ee12735cdefdda5e10c3f38d2"
Nov 04 01:11:45.737994 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.737931    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98265d5211a8a4baae001fa0653a94d3796e7a5ee12735cdefdda5e10c3f38d2"} err="failed to get container status \"98265d5211a8a4baae001fa0653a94d3796e7a5ee12735cdefdda5e10c3f38d2\": rpc error: code = NotFound desc = could not find container \"98265d5211a8a4baae001fa0653a94d3796e7a5ee12735cdefdda5e10c3f38d2\": container with ID starting with 98265d5211a8a4baae001fa0653a94d3796e7a5ee12735cdefdda5e10c3f38d2 not found: ID does not exist"
Nov 04 01:11:45.795241 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:11:45.795205    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b0c9a7e_e097_4ac1_90c9_ab5935c47d47.slice/crio-0f6b421abb37cd9249a959d54d5d3936afafc5bdc6e1af189091d93e8bea8512 WatchSource:0}: Error finding container 0f6b421abb37cd9249a959d54d5d3936afafc5bdc6e1af189091d93e8bea8512: Status 404 returned error can't find the container with id 0f6b421abb37cd9249a959d54d5d3936afafc5bdc6e1af189091d93e8bea8512
Nov 04 01:11:45.797222 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.797200    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 04 01:11:45.906736 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:45.906678    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-f58ff4764-wcwdt" podStartSLOduration=1.906664023 podStartE2EDuration="1.906664023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:11:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:11:45.906280415 +0000 UTC m=+28.458740562" watchObservedRunningTime="2026-11-04 01:11:45.906664023 +0000 UTC m=+28.459124227"
Nov 04 01:11:46.020054 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:46.019954    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bd6bc57c4-p8hhs"]
Nov 04 01:11:46.023783 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:46.023756    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bd6bc57c4-p8hhs"]
Nov 04 01:11:46.738933 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:46.738897    5640 generic.go:356] "Generic (PLEG): container finished" podID="6b0c9a7e-e097-4ac1-90c9-ab5935c47d47" containerID="9fefbe7a74aeb78a6dd5d00f43da68e7200c1203475a3b6c2881f836e27929a6" exitCode=0
Nov 04 01:11:46.739305 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:46.738997    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47","Type":"ContainerDied","Data":"9fefbe7a74aeb78a6dd5d00f43da68e7200c1203475a3b6c2881f836e27929a6"}
Nov 04 01:11:46.739305 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:46.739057    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47","Type":"ContainerStarted","Data":"0f6b421abb37cd9249a959d54d5d3936afafc5bdc6e1af189091d93e8bea8512"}
Nov 04 01:11:47.562838 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:47.562790    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3f67bd09-93fb-4738-b800-36b41330d329" path="/var/lib/kubelet/pods/3f67bd09-93fb-4738-b800-36b41330d329/volumes"
Nov 04 01:11:47.745427 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:47.745389    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47","Type":"ContainerStarted","Data":"0b2f20543332e24a99e206abd1db8ebda3424c5ca75aaf20fe6c86c0fc476aed"}
Nov 04 01:11:47.745945 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:47.745467    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47","Type":"ContainerStarted","Data":"2155fe08fbeac5dc8a9617febadb28262eadb78e21e9a610db30156825f259e8"}
Nov 04 01:11:47.745945 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:47.745506    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47","Type":"ContainerStarted","Data":"829d08ba93e0b51fb46fbfd6fe2fd554920aef33f0ad6307549ab0d786836c7c"}
Nov 04 01:11:47.745945 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:47.745551    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47","Type":"ContainerStarted","Data":"0f0b73525f7cdf3ae9262dc9001c43503f32d735a66758b8777470b738facd32"}
Nov 04 01:11:47.745945 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:47.745595    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47","Type":"ContainerStarted","Data":"2ac26862a207f7cabaf8d9e672b23546f28e938ffbe5b8070bf8708c2af6e8ba"}
Nov 04 01:11:47.745945 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:47.745633    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6b0c9a7e-e097-4ac1-90c9-ab5935c47d47","Type":"ContainerStarted","Data":"77d35cfc26cb8211818c3748da85c25b5a49086598e50fd6fbb565f56c845bbb"}
Nov 04 01:11:47.878492 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:47.878392    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.8670919870000002 podStartE2EDuration="3.878377524s" totalImagesPullingTime="0s" totalInitContainerRuntime="11.285537ms" isStatefulPod=false podCreationTimestamp="2026-11-04 01:11:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:11:47.877730613 +0000 UTC m=+30.430190764" watchObservedRunningTime="2026-11-04 01:11:47.878377524 +0000 UTC m=+30.430837673"
Nov 04 01:11:49.624197 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:49.624168    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zq545"
Nov 04 01:11:55.021697 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:55.021660    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:55.022252 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:55.021746    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:55.026601 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:55.026578    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:55.779131 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:55.779102    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f58ff4764-wcwdt"
Nov 04 01:11:55.953187 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:11:55.953149    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fd47659d6-bl52s"]
Nov 04 01:12:11.141071 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:12:11.141029    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:12:20.974901 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:20.974848    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-5fd47659d6-bl52s" podUID="b12672cc-5caf-4cce-90b1-babce76c4007" containerName="console" containerID="cri-o://1be81ab88ceff52a2c901fe4a03e29f8f9c7dbbb58fa96b852f23904e94fb3dc" gracePeriod=15
Nov 04 01:12:21.224746 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.224722    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:12:21.347746 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.347719    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-service-ca\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-service-ca\") pod \"b12672cc-5caf-4cce-90b1-babce76c4007\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") "
Nov 04 01:12:21.347919 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.347775    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-oauth-serving-cert\") pod \"b12672cc-5caf-4cce-90b1-babce76c4007\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") "
Nov 04 01:12:21.347919 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.347806    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b12672cc-5caf-4cce-90b1-babce76c4007-kube-api-access-kbs8l\" (UniqueName: \"kubernetes.io/projected/b12672cc-5caf-4cce-90b1-babce76c4007-kube-api-access-kbs8l\") pod \"b12672cc-5caf-4cce-90b1-babce76c4007\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") "
Nov 04 01:12:21.348036 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.348009    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b12672cc-5caf-4cce-90b1-babce76c4007-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b12672cc-5caf-4cce-90b1-babce76c4007-console-oauth-config\") pod \"b12672cc-5caf-4cce-90b1-babce76c4007\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") "
Nov 04 01:12:21.348088 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.348079    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-console-config\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-console-config\") pod \"b12672cc-5caf-4cce-90b1-babce76c4007\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") "
Nov 04 01:12:21.348141 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.348100    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b12672cc-5caf-4cce-90b1-babce76c4007-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b12672cc-5caf-4cce-90b1-babce76c4007-console-serving-cert\") pod \"b12672cc-5caf-4cce-90b1-babce76c4007\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") "
Nov 04 01:12:21.348141 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.348127    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b12672cc-5caf-4cce-90b1-babce76c4007-tmp\" (UniqueName: \"kubernetes.io/empty-dir/b12672cc-5caf-4cce-90b1-babce76c4007-tmp\") pod \"b12672cc-5caf-4cce-90b1-babce76c4007\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") "
Nov 04 01:12:21.348248 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.348200    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-trusted-ca-bundle\") pod \"b12672cc-5caf-4cce-90b1-babce76c4007\" (UID: \"b12672cc-5caf-4cce-90b1-babce76c4007\") "
Nov 04 01:12:21.348248 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.348207    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-service-ca" pod "b12672cc-5caf-4cce-90b1-babce76c4007" (UID: "b12672cc-5caf-4cce-90b1-babce76c4007"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:12:21.348416 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.348272    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-oauth-serving-cert" pod "b12672cc-5caf-4cce-90b1-babce76c4007" (UID: "b12672cc-5caf-4cce-90b1-babce76c4007"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:12:21.348560 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.348538    5640 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-service-ca\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:12:21.348625 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.348566    5640 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-oauth-serving-cert\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:12:21.348625 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.348560    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b12672cc-5caf-4cce-90b1-babce76c4007-tmp" pod "b12672cc-5caf-4cce-90b1-babce76c4007" (UID: "b12672cc-5caf-4cce-90b1-babce76c4007"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:12:21.348625 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.348587    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-trusted-ca-bundle" pod "b12672cc-5caf-4cce-90b1-babce76c4007" (UID: "b12672cc-5caf-4cce-90b1-babce76c4007"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:12:21.348625 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.348599    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-console-config" pod "b12672cc-5caf-4cce-90b1-babce76c4007" (UID: "b12672cc-5caf-4cce-90b1-babce76c4007"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:12:21.350259 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.350229    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b12672cc-5caf-4cce-90b1-babce76c4007-kube-api-access-kbs8l" pod "b12672cc-5caf-4cce-90b1-babce76c4007" (UID: "b12672cc-5caf-4cce-90b1-babce76c4007"). InnerVolumeSpecName "kube-api-access-kbs8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:12:21.350531 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.350505    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b12672cc-5caf-4cce-90b1-babce76c4007-console-oauth-config" pod "b12672cc-5caf-4cce-90b1-babce76c4007" (UID: "b12672cc-5caf-4cce-90b1-babce76c4007"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:12:21.350722 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.350704    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b12672cc-5caf-4cce-90b1-babce76c4007-console-serving-cert" pod "b12672cc-5caf-4cce-90b1-babce76c4007" (UID: "b12672cc-5caf-4cce-90b1-babce76c4007"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:12:21.448905 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.448870    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbs8l\" (UniqueName: \"kubernetes.io/projected/b12672cc-5caf-4cce-90b1-babce76c4007-kube-api-access-kbs8l\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:12:21.448905 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.448904    5640 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b12672cc-5caf-4cce-90b1-babce76c4007-console-oauth-config\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:12:21.449138 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.448922    5640 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-console-config\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:12:21.449138 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.448934    5640 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b12672cc-5caf-4cce-90b1-babce76c4007-console-serving-cert\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:12:21.449138 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.448948    5640 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b12672cc-5caf-4cce-90b1-babce76c4007-tmp\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:12:21.449138 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.448962    5640 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b12672cc-5caf-4cce-90b1-babce76c4007-trusted-ca-bundle\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:12:21.858143 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.858112    5640 generic.go:356] "Generic (PLEG): container finished" podID="b12672cc-5caf-4cce-90b1-babce76c4007" containerID="1be81ab88ceff52a2c901fe4a03e29f8f9c7dbbb58fa96b852f23904e94fb3dc" exitCode=0
Nov 04 01:12:21.858313 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.858162    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fd47659d6-bl52s"
Nov 04 01:12:21.858313 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.858159    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fd47659d6-bl52s" event={"ID":"b12672cc-5caf-4cce-90b1-babce76c4007","Type":"ContainerDied","Data":"1be81ab88ceff52a2c901fe4a03e29f8f9c7dbbb58fa96b852f23904e94fb3dc"}
Nov 04 01:12:21.858313 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.858287    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fd47659d6-bl52s" event={"ID":"b12672cc-5caf-4cce-90b1-babce76c4007","Type":"ContainerDied","Data":"c5e29cbdf14d41b458afd33c96d760f5b7e1c9109ba069496ad35edc383f3cd6"}
Nov 04 01:12:21.858459 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.858314    5640 scope.go:122] "RemoveContainer" containerID="1be81ab88ceff52a2c901fe4a03e29f8f9c7dbbb58fa96b852f23904e94fb3dc"
Nov 04 01:12:21.865890 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.865872    5640 scope.go:122] "RemoveContainer" containerID="1be81ab88ceff52a2c901fe4a03e29f8f9c7dbbb58fa96b852f23904e94fb3dc"
Nov 04 01:12:21.866175 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:12:21.866158    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1be81ab88ceff52a2c901fe4a03e29f8f9c7dbbb58fa96b852f23904e94fb3dc\": container with ID starting with 1be81ab88ceff52a2c901fe4a03e29f8f9c7dbbb58fa96b852f23904e94fb3dc not found: ID does not exist" containerID="1be81ab88ceff52a2c901fe4a03e29f8f9c7dbbb58fa96b852f23904e94fb3dc"
Nov 04 01:12:21.866237 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:21.866183    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be81ab88ceff52a2c901fe4a03e29f8f9c7dbbb58fa96b852f23904e94fb3dc"} err="failed to get container status \"1be81ab88ceff52a2c901fe4a03e29f8f9c7dbbb58fa96b852f23904e94fb3dc\": rpc error: code = NotFound desc = could not find container \"1be81ab88ceff52a2c901fe4a03e29f8f9c7dbbb58fa96b852f23904e94fb3dc\": container with ID starting with 1be81ab88ceff52a2c901fe4a03e29f8f9c7dbbb58fa96b852f23904e94fb3dc not found: ID does not exist"
Nov 04 01:12:22.027572 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:22.027540    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fd47659d6-bl52s"]
Nov 04 01:12:22.079109 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:22.079079    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fd47659d6-bl52s"]
Nov 04 01:12:23.562345 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:12:23.562314    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b12672cc-5caf-4cce-90b1-babce76c4007" path="/var/lib/kubelet/pods/b12672cc-5caf-4cce-90b1-babce76c4007/volumes"
Nov 04 01:12:41.140201 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:12:41.140163    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:13:11.139709 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:13:11.139625    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:13:41.140223 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:13:41.140188    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:14:11.142448 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:14:11.142406    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:14:41.141211 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:14:41.141166    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:15:11.141077 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:15:11.141031    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:15:41.140178 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:15:41.140143    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:16:11.139779 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:16:11.139741    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:16:41.141139 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:16:41.141103    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:17:11.140586 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:17:11.140543    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:17:41.139994 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:17:41.139934    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:17:41.808146 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.808116    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v"]
Nov 04 01:17:41.808476 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.808459    5640 cpu_manager.go:414] "containerMap: removing container" podUID="b12672cc-5caf-4cce-90b1-babce76c4007" containerName="console"
Nov 04 01:17:41.808559 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.808479    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b12672cc-5caf-4cce-90b1-babce76c4007" containerName="console"
Nov 04 01:17:41.808559 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.808553    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="b12672cc-5caf-4cce-90b1-babce76c4007" containerName="console"
Nov 04 01:17:41.810745 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.810722    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v"
Nov 04 01:17:41.836826 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.836793    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj"]
Nov 04 01:17:41.839216 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.839195    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj"
Nov 04 01:17:41.844575 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.844550    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a5f87ee-8789-47f1-b9d7-502e9d0177ca-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj\" (UID: \"5a5f87ee-8789-47f1-b9d7-502e9d0177ca\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj"
Nov 04 01:17:41.844697 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.844583    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd68j\" (UniqueName: \"kubernetes.io/projected/a48980ea-c5e1-447b-8fdc-458d4c8b993f-kube-api-access-zd68j\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v\" (UID: \"a48980ea-c5e1-447b-8fdc-458d4c8b993f\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v"
Nov 04 01:17:41.844697 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.844602    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a48980ea-c5e1-447b-8fdc-458d4c8b993f-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v\" (UID: \"a48980ea-c5e1-447b-8fdc-458d4c8b993f\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v"
Nov 04 01:17:41.844820 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.844697    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdh48\" (UniqueName: \"kubernetes.io/projected/5a5f87ee-8789-47f1-b9d7-502e9d0177ca-kube-api-access-pdh48\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj\" (UID: \"5a5f87ee-8789-47f1-b9d7-502e9d0177ca\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj"
Nov 04 01:17:41.844820 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.844718    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a48980ea-c5e1-447b-8fdc-458d4c8b993f-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v\" (UID: \"a48980ea-c5e1-447b-8fdc-458d4c8b993f\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v"
Nov 04 01:17:41.844820 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.844738    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a5f87ee-8789-47f1-b9d7-502e9d0177ca-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj\" (UID: \"5a5f87ee-8789-47f1-b9d7-502e9d0177ca\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj"
Nov 04 01:17:41.887932 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.887902    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Nov 04 01:17:41.887932 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.887900    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Nov 04 01:17:41.888189 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.888109    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-qjp2r\""
Nov 04 01:17:41.919779 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.919749    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v"]
Nov 04 01:17:41.920155 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.920134    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj"]
Nov 04 01:17:41.945195 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.945165    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a48980ea-c5e1-447b-8fdc-458d4c8b993f-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v\" (UID: \"a48980ea-c5e1-447b-8fdc-458d4c8b993f\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v"
Nov 04 01:17:41.945358 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.945205    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a5f87ee-8789-47f1-b9d7-502e9d0177ca-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj\" (UID: \"5a5f87ee-8789-47f1-b9d7-502e9d0177ca\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj"
Nov 04 01:17:41.945358 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.945271    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a5f87ee-8789-47f1-b9d7-502e9d0177ca-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj\" (UID: \"5a5f87ee-8789-47f1-b9d7-502e9d0177ca\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj"
Nov 04 01:17:41.945358 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.945297    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd68j\" (UniqueName: \"kubernetes.io/projected/a48980ea-c5e1-447b-8fdc-458d4c8b993f-kube-api-access-zd68j\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v\" (UID: \"a48980ea-c5e1-447b-8fdc-458d4c8b993f\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v"
Nov 04 01:17:41.945358 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.945323    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a48980ea-c5e1-447b-8fdc-458d4c8b993f-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v\" (UID: \"a48980ea-c5e1-447b-8fdc-458d4c8b993f\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v"
Nov 04 01:17:41.945358 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.945353    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdh48\" (UniqueName: \"kubernetes.io/projected/5a5f87ee-8789-47f1-b9d7-502e9d0177ca-kube-api-access-pdh48\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj\" (UID: \"5a5f87ee-8789-47f1-b9d7-502e9d0177ca\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj"
Nov 04 01:17:41.945669 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.945642    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a48980ea-c5e1-447b-8fdc-458d4c8b993f-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v\" (UID: \"a48980ea-c5e1-447b-8fdc-458d4c8b993f\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v"
Nov 04 01:17:41.945780 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.945642    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a5f87ee-8789-47f1-b9d7-502e9d0177ca-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj\" (UID: \"5a5f87ee-8789-47f1-b9d7-502e9d0177ca\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj"
Nov 04 01:17:41.945780 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.945680    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a5f87ee-8789-47f1-b9d7-502e9d0177ca-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj\" (UID: \"5a5f87ee-8789-47f1-b9d7-502e9d0177ca\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj"
Nov 04 01:17:41.945780 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.945681    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a48980ea-c5e1-447b-8fdc-458d4c8b993f-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v\" (UID: \"a48980ea-c5e1-447b-8fdc-458d4c8b993f\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v"
Nov 04 01:17:41.967759 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:41.967737    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-4ldtx\""
Nov 04 01:17:42.007897 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.007866    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd68j\" (UniqueName: \"kubernetes.io/projected/a48980ea-c5e1-447b-8fdc-458d4c8b993f-kube-api-access-zd68j\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v\" (UID: \"a48980ea-c5e1-447b-8fdc-458d4c8b993f\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v"
Nov 04 01:17:42.008045 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.007933    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdh48\" (UniqueName: \"kubernetes.io/projected/5a5f87ee-8789-47f1-b9d7-502e9d0177ca-kube-api-access-pdh48\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj\" (UID: \"5a5f87ee-8789-47f1-b9d7-502e9d0177ca\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj"
Nov 04 01:17:42.123751 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.123663    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v"
Nov 04 01:17:42.152107 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.152072    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj"
Nov 04 01:17:42.309680 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.309650    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"]
Nov 04 01:17:42.312051 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.312033    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:42.348234 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.348207    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5296344-7037-41f8-8455-80afec73c555-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-p567b\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:42.348359 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.348248    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5296344-7037-41f8-8455-80afec73c555-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-p567b\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:42.348359 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.348270    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5296344-7037-41f8-8455-80afec73c555-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-p567b\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:42.348359 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.348343    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5296344-7037-41f8-8455-80afec73c555-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-p567b\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:42.348457 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.348373    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5296344-7037-41f8-8455-80afec73c555-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-p567b\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:42.348457 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.348446    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5296344-7037-41f8-8455-80afec73c555-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-p567b\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:42.348517 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.348472    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfqvp\" (UniqueName: \"kubernetes.io/projected/c5296344-7037-41f8-8455-80afec73c555-kube-api-access-cfqvp\") pod \"istiod-openshift-gateway-7876bfcb74-p567b\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:42.366956 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.366935    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Nov 04 01:17:42.369734 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.369715    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Nov 04 01:17:42.371270 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.371247    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"]
Nov 04 01:17:42.372934 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.372916    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Nov 04 01:17:42.373051 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.372999    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-b44fv\""
Nov 04 01:17:42.449166 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.449090    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5296344-7037-41f8-8455-80afec73c555-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-p567b\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:42.449166 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.449123    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5296344-7037-41f8-8455-80afec73c555-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-p567b\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:42.449166 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.449159    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5296344-7037-41f8-8455-80afec73c555-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-p567b\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:42.449437 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.449181    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfqvp\" (UniqueName: \"kubernetes.io/projected/c5296344-7037-41f8-8455-80afec73c555-kube-api-access-cfqvp\") pod \"istiod-openshift-gateway-7876bfcb74-p567b\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:42.449437 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.449206    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5296344-7037-41f8-8455-80afec73c555-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-p567b\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:42.449437 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.449235    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5296344-7037-41f8-8455-80afec73c555-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-p567b\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:42.449437 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.449253    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5296344-7037-41f8-8455-80afec73c555-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-p567b\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:42.451653 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.451620    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5296344-7037-41f8-8455-80afec73c555-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-p567b\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:42.451757 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.451675    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5296344-7037-41f8-8455-80afec73c555-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-p567b\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:42.451757 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.451677    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5296344-7037-41f8-8455-80afec73c555-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-p567b\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:42.466908 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.466889    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Nov 04 01:17:42.467015 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.466947    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Nov 04 01:17:42.470421 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.470404    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5296344-7037-41f8-8455-80afec73c555-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-p567b\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:42.471675 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.471661    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Nov 04 01:17:42.481884 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.481864    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5296344-7037-41f8-8455-80afec73c555-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-p567b\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:42.511835 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.511809    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5296344-7037-41f8-8455-80afec73c555-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-p567b\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:42.511921 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.511839    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfqvp\" (UniqueName: \"kubernetes.io/projected/c5296344-7037-41f8-8455-80afec73c555-kube-api-access-cfqvp\") pod \"istiod-openshift-gateway-7876bfcb74-p567b\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:42.530613 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.530594    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v"]
Nov 04 01:17:42.532801 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:17:42.532771    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda48980ea_c5e1_447b_8fdc_458d4c8b993f.slice/crio-3cb224f9c72901d8f109199110e150061969ca2275ef99ce47929367c39162c2 WatchSource:0}: Error finding container 3cb224f9c72901d8f109199110e150061969ca2275ef99ce47929367c39162c2: Status 404 returned error can't find the container with id 3cb224f9c72901d8f109199110e150061969ca2275ef99ce47929367c39162c2
Nov 04 01:17:42.534735 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.534719    5640 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 01:17:42.552561 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.552543    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj"]
Nov 04 01:17:42.554817 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:17:42.554794    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a5f87ee_8789_47f1_b9d7_502e9d0177ca.slice/crio-d1bdc0fffbec91a0a28fbabe81a5c74a60e2f84eb6ea536d41d3e1e022526c3d WatchSource:0}: Error finding container d1bdc0fffbec91a0a28fbabe81a5c74a60e2f84eb6ea536d41d3e1e022526c3d: Status 404 returned error can't find the container with id d1bdc0fffbec91a0a28fbabe81a5c74a60e2f84eb6ea536d41d3e1e022526c3d
Nov 04 01:17:42.622269 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.622232    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:42.882502 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.882464    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj" event={"ID":"5a5f87ee-8789-47f1-b9d7-502e9d0177ca","Type":"ContainerStarted","Data":"d1bdc0fffbec91a0a28fbabe81a5c74a60e2f84eb6ea536d41d3e1e022526c3d"}
Nov 04 01:17:42.883549 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.883522    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v" event={"ID":"a48980ea-c5e1-447b-8fdc-458d4c8b993f","Type":"ContainerStarted","Data":"3cb224f9c72901d8f109199110e150061969ca2275ef99ce47929367c39162c2"}
Nov 04 01:17:42.997857 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:42.997824    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"]
Nov 04 01:17:43.000599 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:17:43.000569    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5296344_7037_41f8_8455_80afec73c555.slice/crio-ab95e2c1c4e95404ea40ab63a28490b20a0b9c4dd80927d0aeea5817a40ab2c4 WatchSource:0}: Error finding container ab95e2c1c4e95404ea40ab63a28490b20a0b9c4dd80927d0aeea5817a40ab2c4: Status 404 returned error can't find the container with id ab95e2c1c4e95404ea40ab63a28490b20a0b9c4dd80927d0aeea5817a40ab2c4
Nov 04 01:17:43.888354 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:43.888316    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b" event={"ID":"c5296344-7037-41f8-8455-80afec73c555","Type":"ContainerStarted","Data":"ab95e2c1c4e95404ea40ab63a28490b20a0b9c4dd80927d0aeea5817a40ab2c4"}
Nov 04 01:17:47.560860 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:47.560829    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:17:47.561254 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:47.560905    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:17:47.906205 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:47.906131    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b" event={"ID":"c5296344-7037-41f8-8455-80afec73c555","Type":"ContainerStarted","Data":"477814b04b06f2d6ddbd3377adc5537dfec0c56ec9b10997091610413a379421"}
Nov 04 01:17:47.906351 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:47.906236    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:48.133188 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:48.133131    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b" podStartSLOduration=1.575766196 podStartE2EDuration="6.133115197s" totalImagesPullingTime="4.557349001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:17:48.08176098 +0000 UTC m=+390.634221135" watchObservedRunningTime="2026-11-04 01:17:48.133115197 +0000 UTC m=+390.685575326"
Nov 04 01:17:48.912817 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:48.912503    5640 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-p567b container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 01:17:48.912817 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:48.912575    5640 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b" podUID="c5296344-7037-41f8-8455-80afec73c555" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 01:17:50.920005 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:50.919943    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj" event={"ID":"5a5f87ee-8789-47f1-b9d7-502e9d0177ca","Type":"ContainerStarted","Data":"a602b3de3c5a8c3017d562ba611b8300f9ed53e76fb119e9f897b6718d111ad9"}
Nov 04 01:17:51.912095 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:51.912065    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:17:51.925118 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:51.925081    5640 generic.go:356] "Generic (PLEG): container finished" podID="5a5f87ee-8789-47f1-b9d7-502e9d0177ca" containerID="a602b3de3c5a8c3017d562ba611b8300f9ed53e76fb119e9f897b6718d111ad9" exitCode=0
Nov 04 01:17:51.925540 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:51.925163    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj" event={"ID":"5a5f87ee-8789-47f1-b9d7-502e9d0177ca","Type":"ContainerDied","Data":"a602b3de3c5a8c3017d562ba611b8300f9ed53e76fb119e9f897b6718d111ad9"}
Nov 04 01:17:51.926603 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:51.926498    5640 generic.go:356] "Generic (PLEG): container finished" podID="a48980ea-c5e1-447b-8fdc-458d4c8b993f" containerID="9116d4eb3a15f0c4edadd3dcb3b83485b0e808a4799bd1961c5310358f2be2b3" exitCode=0
Nov 04 01:17:51.926603 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:51.926526    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v" event={"ID":"a48980ea-c5e1-447b-8fdc-458d4c8b993f","Type":"ContainerDied","Data":"9116d4eb3a15f0c4edadd3dcb3b83485b0e808a4799bd1961c5310358f2be2b3"}
Nov 04 01:17:53.935053 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:53.935018    5640 generic.go:356] "Generic (PLEG): container finished" podID="5a5f87ee-8789-47f1-b9d7-502e9d0177ca" containerID="0053088ea3352b4681745431cf0708c18db625fc358c85d5d9d065d1e63741cb" exitCode=0
Nov 04 01:17:53.935462 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:53.935110    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj" event={"ID":"5a5f87ee-8789-47f1-b9d7-502e9d0177ca","Type":"ContainerDied","Data":"0053088ea3352b4681745431cf0708c18db625fc358c85d5d9d065d1e63741cb"}
Nov 04 01:17:56.947196 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:56.947162    5640 generic.go:356] "Generic (PLEG): container finished" podID="a48980ea-c5e1-447b-8fdc-458d4c8b993f" containerID="3c825bf875b668fffd4e00942a5a513981bbea06862ca967fa9426efd632a17c" exitCode=0
Nov 04 01:17:56.947680 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:17:56.947203    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v" event={"ID":"a48980ea-c5e1-447b-8fdc-458d4c8b993f","Type":"ContainerDied","Data":"3c825bf875b668fffd4e00942a5a513981bbea06862ca967fa9426efd632a17c"}
Nov 04 01:18:04.981178 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:04.981078    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v" event={"ID":"a48980ea-c5e1-447b-8fdc-458d4c8b993f","Type":"ContainerStarted","Data":"3f27a6631071a97f8d06eb0cab9ac50052513d0c4775ed357db9ddc9dd155ee6"}
Nov 04 01:18:05.102110 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:05.102041    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v" podStartSLOduration=2.87379031 podStartE2EDuration="24.102023369s" totalImagesPullingTime="21.228233059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:17:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:18:05.101808662 +0000 UTC m=+407.654268824" watchObservedRunningTime="2026-11-04 01:18:05.102023369 +0000 UTC m=+407.654483494"
Nov 04 01:18:05.987635 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:05.987599    5640 generic.go:356] "Generic (PLEG): container finished" podID="a48980ea-c5e1-447b-8fdc-458d4c8b993f" containerID="3f27a6631071a97f8d06eb0cab9ac50052513d0c4775ed357db9ddc9dd155ee6" exitCode=0
Nov 04 01:18:05.988060 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:05.987645    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v" event={"ID":"a48980ea-c5e1-447b-8fdc-458d4c8b993f","Type":"ContainerDied","Data":"3f27a6631071a97f8d06eb0cab9ac50052513d0c4775ed357db9ddc9dd155ee6"}
Nov 04 01:18:06.993476 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:06.993388    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj" event={"ID":"5a5f87ee-8789-47f1-b9d7-502e9d0177ca","Type":"ContainerStarted","Data":"9026359a62adb2d52e60b014e70b921b77be655fdc4dd0454cf3384c4e5754e0"}
Nov 04 01:18:07.114559 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:07.114512    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj" podStartSLOduration=4.005093559 podStartE2EDuration="26.114497985s" totalImagesPullingTime="22.109404426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:17:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:18:07.113774019 +0000 UTC m=+409.666234165" watchObservedRunningTime="2026-11-04 01:18:07.114497985 +0000 UTC m=+409.666958110"
Nov 04 01:18:07.133383 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:07.133350    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v"
Nov 04 01:18:07.268127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:07.268042    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a48980ea-c5e1-447b-8fdc-458d4c8b993f-util\" (UniqueName: \"kubernetes.io/empty-dir/a48980ea-c5e1-447b-8fdc-458d4c8b993f-util\") pod \"a48980ea-c5e1-447b-8fdc-458d4c8b993f\" (UID: \"a48980ea-c5e1-447b-8fdc-458d4c8b993f\") "
Nov 04 01:18:07.268127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:07.268097    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a48980ea-c5e1-447b-8fdc-458d4c8b993f-bundle\" (UniqueName: \"kubernetes.io/empty-dir/a48980ea-c5e1-447b-8fdc-458d4c8b993f-bundle\") pod \"a48980ea-c5e1-447b-8fdc-458d4c8b993f\" (UID: \"a48980ea-c5e1-447b-8fdc-458d4c8b993f\") "
Nov 04 01:18:07.268127 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:07.268122    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a48980ea-c5e1-447b-8fdc-458d4c8b993f-kube-api-access-zd68j\" (UniqueName: \"kubernetes.io/projected/a48980ea-c5e1-447b-8fdc-458d4c8b993f-kube-api-access-zd68j\") pod \"a48980ea-c5e1-447b-8fdc-458d4c8b993f\" (UID: \"a48980ea-c5e1-447b-8fdc-458d4c8b993f\") "
Nov 04 01:18:07.268712 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:07.268690    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a48980ea-c5e1-447b-8fdc-458d4c8b993f-bundle" pod "a48980ea-c5e1-447b-8fdc-458d4c8b993f" (UID: "a48980ea-c5e1-447b-8fdc-458d4c8b993f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:18:07.270653 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:07.270629    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a48980ea-c5e1-447b-8fdc-458d4c8b993f-kube-api-access-zd68j" pod "a48980ea-c5e1-447b-8fdc-458d4c8b993f" (UID: "a48980ea-c5e1-447b-8fdc-458d4c8b993f"). InnerVolumeSpecName "kube-api-access-zd68j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:18:07.273010 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:07.272989    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a48980ea-c5e1-447b-8fdc-458d4c8b993f-util" pod "a48980ea-c5e1-447b-8fdc-458d4c8b993f" (UID: "a48980ea-c5e1-447b-8fdc-458d4c8b993f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:18:07.369202 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:07.369170    5640 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a48980ea-c5e1-447b-8fdc-458d4c8b993f-util\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:07.369202 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:07.369201    5640 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a48980ea-c5e1-447b-8fdc-458d4c8b993f-bundle\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:07.369202 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:07.369212    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd68j\" (UniqueName: \"kubernetes.io/projected/a48980ea-c5e1-447b-8fdc-458d4c8b993f-kube-api-access-zd68j\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:07.999424 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:07.999338    5640 generic.go:356] "Generic (PLEG): container finished" podID="5a5f87ee-8789-47f1-b9d7-502e9d0177ca" containerID="9026359a62adb2d52e60b014e70b921b77be655fdc4dd0454cf3384c4e5754e0" exitCode=0
Nov 04 01:18:07.999880 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:07.999425    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj" event={"ID":"5a5f87ee-8789-47f1-b9d7-502e9d0177ca","Type":"ContainerDied","Data":"9026359a62adb2d52e60b014e70b921b77be655fdc4dd0454cf3384c4e5754e0"}
Nov 04 01:18:08.001310 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:08.001288    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v" event={"ID":"a48980ea-c5e1-447b-8fdc-458d4c8b993f","Type":"ContainerDied","Data":"3cb224f9c72901d8f109199110e150061969ca2275ef99ce47929367c39162c2"}
Nov 04 01:18:08.001420 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:08.001322    5640 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cb224f9c72901d8f109199110e150061969ca2275ef99ce47929367c39162c2"
Nov 04 01:18:08.001420 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:08.001295    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c5fh4v"
Nov 04 01:18:09.124039 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:09.124015    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj"
Nov 04 01:18:09.183433 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:09.183400    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a5f87ee-8789-47f1-b9d7-502e9d0177ca-util\" (UniqueName: \"kubernetes.io/empty-dir/5a5f87ee-8789-47f1-b9d7-502e9d0177ca-util\") pod \"5a5f87ee-8789-47f1-b9d7-502e9d0177ca\" (UID: \"5a5f87ee-8789-47f1-b9d7-502e9d0177ca\") "
Nov 04 01:18:09.183600 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:09.183457    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5a5f87ee-8789-47f1-b9d7-502e9d0177ca-kube-api-access-pdh48\" (UniqueName: \"kubernetes.io/projected/5a5f87ee-8789-47f1-b9d7-502e9d0177ca-kube-api-access-pdh48\") pod \"5a5f87ee-8789-47f1-b9d7-502e9d0177ca\" (UID: \"5a5f87ee-8789-47f1-b9d7-502e9d0177ca\") "
Nov 04 01:18:09.183600 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:09.183487    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a5f87ee-8789-47f1-b9d7-502e9d0177ca-bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a5f87ee-8789-47f1-b9d7-502e9d0177ca-bundle\") pod \"5a5f87ee-8789-47f1-b9d7-502e9d0177ca\" (UID: \"5a5f87ee-8789-47f1-b9d7-502e9d0177ca\") "
Nov 04 01:18:09.184222 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:09.184190    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a5f87ee-8789-47f1-b9d7-502e9d0177ca-bundle" pod "5a5f87ee-8789-47f1-b9d7-502e9d0177ca" (UID: "5a5f87ee-8789-47f1-b9d7-502e9d0177ca"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:18:09.185569 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:09.185537    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a5f87ee-8789-47f1-b9d7-502e9d0177ca-kube-api-access-pdh48" pod "5a5f87ee-8789-47f1-b9d7-502e9d0177ca" (UID: "5a5f87ee-8789-47f1-b9d7-502e9d0177ca"). InnerVolumeSpecName "kube-api-access-pdh48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:18:09.187826 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:09.187806    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a5f87ee-8789-47f1-b9d7-502e9d0177ca-util" pod "5a5f87ee-8789-47f1-b9d7-502e9d0177ca" (UID: "5a5f87ee-8789-47f1-b9d7-502e9d0177ca"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:18:09.284417 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:09.284389    5640 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a5f87ee-8789-47f1-b9d7-502e9d0177ca-util\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:09.284570 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:09.284420    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdh48\" (UniqueName: \"kubernetes.io/projected/5a5f87ee-8789-47f1-b9d7-502e9d0177ca-kube-api-access-pdh48\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:09.284570 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:09.284432    5640 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a5f87ee-8789-47f1-b9d7-502e9d0177ca-bundle\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:10.010275 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:10.010190    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj" event={"ID":"5a5f87ee-8789-47f1-b9d7-502e9d0177ca","Type":"ContainerDied","Data":"d1bdc0fffbec91a0a28fbabe81a5c74a60e2f84eb6ea536d41d3e1e022526c3d"}
Nov 04 01:18:10.010275 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:10.010242    5640 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1bdc0fffbec91a0a28fbabe81a5c74a60e2f84eb6ea536d41d3e1e022526c3d"
Nov 04 01:18:10.010275 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:10.010208    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71glqzj"
Nov 04 01:18:11.141845 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:18:11.141809    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:18:26.492485 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.492448    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"]
Nov 04 01:18:26.492877 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.492753    5640 cpu_manager.go:414] "containerMap: removing container" podUID="5a5f87ee-8789-47f1-b9d7-502e9d0177ca" containerName="util"
Nov 04 01:18:26.492877 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.492764    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5a5f87ee-8789-47f1-b9d7-502e9d0177ca" containerName="util"
Nov 04 01:18:26.492877 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.492777    5640 cpu_manager.go:414] "containerMap: removing container" podUID="5a5f87ee-8789-47f1-b9d7-502e9d0177ca" containerName="pull"
Nov 04 01:18:26.492877 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.492782    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5a5f87ee-8789-47f1-b9d7-502e9d0177ca" containerName="pull"
Nov 04 01:18:26.492877 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.492798    5640 cpu_manager.go:414] "containerMap: removing container" podUID="a48980ea-c5e1-447b-8fdc-458d4c8b993f" containerName="util"
Nov 04 01:18:26.492877 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.492803    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a48980ea-c5e1-447b-8fdc-458d4c8b993f" containerName="util"
Nov 04 01:18:26.492877 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.492809    5640 cpu_manager.go:414] "containerMap: removing container" podUID="a48980ea-c5e1-447b-8fdc-458d4c8b993f" containerName="extract"
Nov 04 01:18:26.492877 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.492814    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a48980ea-c5e1-447b-8fdc-458d4c8b993f" containerName="extract"
Nov 04 01:18:26.492877 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.492823    5640 cpu_manager.go:414] "containerMap: removing container" podUID="5a5f87ee-8789-47f1-b9d7-502e9d0177ca" containerName="extract"
Nov 04 01:18:26.492877 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.492828    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5a5f87ee-8789-47f1-b9d7-502e9d0177ca" containerName="extract"
Nov 04 01:18:26.492877 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.492836    5640 cpu_manager.go:414] "containerMap: removing container" podUID="a48980ea-c5e1-447b-8fdc-458d4c8b993f" containerName="pull"
Nov 04 01:18:26.492877 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.492840    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a48980ea-c5e1-447b-8fdc-458d4c8b993f" containerName="pull"
Nov 04 01:18:26.493252 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.492885    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="a48980ea-c5e1-447b-8fdc-458d4c8b993f" containerName="extract"
Nov 04 01:18:26.493252 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.492893    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="5a5f87ee-8789-47f1-b9d7-502e9d0177ca" containerName="extract"
Nov 04 01:18:26.495102 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.495086    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"
Nov 04 01:18:26.598029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.597997    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Nov 04 01:18:26.598214 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.598067    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Nov 04 01:18:26.600928 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.600901    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Nov 04 01:18:26.601148 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.600999    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Nov 04 01:18:26.601215 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.601201    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-7sbgk\""
Nov 04 01:18:26.601293 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.601212    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Nov 04 01:18:26.607632 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.607610    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"]
Nov 04 01:18:26.627230 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.627203    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d30ea1fb-032a-4d84-9c4e-dd1f725b83e9-manifests\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-v842j\" (UID: \"d30ea1fb-032a-4d84-9c4e-dd1f725b83e9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"
Nov 04 01:18:26.627394 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.627238    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2jcb\" (UniqueName: \"kubernetes.io/projected/d30ea1fb-032a-4d84-9c4e-dd1f725b83e9-kube-api-access-t2jcb\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-v842j\" (UID: \"d30ea1fb-032a-4d84-9c4e-dd1f725b83e9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"
Nov 04 01:18:26.627394 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.627265    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d30ea1fb-032a-4d84-9c4e-dd1f725b83e9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-v842j\" (UID: \"d30ea1fb-032a-4d84-9c4e-dd1f725b83e9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"
Nov 04 01:18:26.627394 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.627337    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d30ea1fb-032a-4d84-9c4e-dd1f725b83e9-metrics-cert\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-v842j\" (UID: \"d30ea1fb-032a-4d84-9c4e-dd1f725b83e9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"
Nov 04 01:18:26.627645 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.627463    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d30ea1fb-032a-4d84-9c4e-dd1f725b83e9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-v842j\" (UID: \"d30ea1fb-032a-4d84-9c4e-dd1f725b83e9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"
Nov 04 01:18:26.627645 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.627489    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d30ea1fb-032a-4d84-9c4e-dd1f725b83e9-tmp\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-v842j\" (UID: \"d30ea1fb-032a-4d84-9c4e-dd1f725b83e9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"
Nov 04 01:18:26.728809 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.728775    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d30ea1fb-032a-4d84-9c4e-dd1f725b83e9-tmp\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-v842j\" (UID: \"d30ea1fb-032a-4d84-9c4e-dd1f725b83e9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"
Nov 04 01:18:26.729009 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.728817    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d30ea1fb-032a-4d84-9c4e-dd1f725b83e9-manifests\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-v842j\" (UID: \"d30ea1fb-032a-4d84-9c4e-dd1f725b83e9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"
Nov 04 01:18:26.729009 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.728955    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2jcb\" (UniqueName: \"kubernetes.io/projected/d30ea1fb-032a-4d84-9c4e-dd1f725b83e9-kube-api-access-t2jcb\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-v842j\" (UID: \"d30ea1fb-032a-4d84-9c4e-dd1f725b83e9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"
Nov 04 01:18:26.729143 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.729040    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d30ea1fb-032a-4d84-9c4e-dd1f725b83e9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-v842j\" (UID: \"d30ea1fb-032a-4d84-9c4e-dd1f725b83e9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"
Nov 04 01:18:26.729241 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.729190    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d30ea1fb-032a-4d84-9c4e-dd1f725b83e9-metrics-cert\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-v842j\" (UID: \"d30ea1fb-032a-4d84-9c4e-dd1f725b83e9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"
Nov 04 01:18:26.729317 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.729298    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d30ea1fb-032a-4d84-9c4e-dd1f725b83e9-manifests\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-v842j\" (UID: \"d30ea1fb-032a-4d84-9c4e-dd1f725b83e9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"
Nov 04 01:18:26.729552 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.729529    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d30ea1fb-032a-4d84-9c4e-dd1f725b83e9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-v842j\" (UID: \"d30ea1fb-032a-4d84-9c4e-dd1f725b83e9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"
Nov 04 01:18:26.731184 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.731155    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d30ea1fb-032a-4d84-9c4e-dd1f725b83e9-tmp\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-v842j\" (UID: \"d30ea1fb-032a-4d84-9c4e-dd1f725b83e9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"
Nov 04 01:18:26.731546 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.731526    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d30ea1fb-032a-4d84-9c4e-dd1f725b83e9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-v842j\" (UID: \"d30ea1fb-032a-4d84-9c4e-dd1f725b83e9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"
Nov 04 01:18:26.731615 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.731569    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d30ea1fb-032a-4d84-9c4e-dd1f725b83e9-metrics-cert\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-v842j\" (UID: \"d30ea1fb-032a-4d84-9c4e-dd1f725b83e9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"
Nov 04 01:18:26.731788 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.731771    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d30ea1fb-032a-4d84-9c4e-dd1f725b83e9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-v842j\" (UID: \"d30ea1fb-032a-4d84-9c4e-dd1f725b83e9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"
Nov 04 01:18:26.795474 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.795431    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2jcb\" (UniqueName: \"kubernetes.io/projected/d30ea1fb-032a-4d84-9c4e-dd1f725b83e9-kube-api-access-t2jcb\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-v842j\" (UID: \"d30ea1fb-032a-4d84-9c4e-dd1f725b83e9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"
Nov 04 01:18:26.808121 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:26.808095    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"
Nov 04 01:18:27.309396 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:27.309371    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"]
Nov 04 01:18:27.311452 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:18:27.311423    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd30ea1fb_032a_4d84_9c4e_dd1f725b83e9.slice/crio-c776be81c794136c5b01b883b64b9c5186d84154fd97ab6f91610af6df66e05b WatchSource:0}: Error finding container c776be81c794136c5b01b883b64b9c5186d84154fd97ab6f91610af6df66e05b: Status 404 returned error can't find the container with id c776be81c794136c5b01b883b64b9c5186d84154fd97ab6f91610af6df66e05b
Nov 04 01:18:28.077445 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:28.077409    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j" event={"ID":"d30ea1fb-032a-4d84-9c4e-dd1f725b83e9","Type":"ContainerStarted","Data":"c776be81c794136c5b01b883b64b9c5186d84154fd97ab6f91610af6df66e05b"}
Nov 04 01:18:31.092796 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:31.092759    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j" event={"ID":"d30ea1fb-032a-4d84-9c4e-dd1f725b83e9","Type":"ContainerStarted","Data":"a0d5cf277ee2db33f362650f54b20cec48dd3c81e4dc164c6615d58e9e09ece0"}
Nov 04 01:18:32.097386 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:32.097349    5640 generic.go:356] "Generic (PLEG): container finished" podID="d30ea1fb-032a-4d84-9c4e-dd1f725b83e9" containerID="a0d5cf277ee2db33f362650f54b20cec48dd3c81e4dc164c6615d58e9e09ece0" exitCode=0
Nov 04 01:18:32.097770 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:32.097413    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j" event={"ID":"d30ea1fb-032a-4d84-9c4e-dd1f725b83e9","Type":"ContainerDied","Data":"a0d5cf277ee2db33f362650f54b20cec48dd3c81e4dc164c6615d58e9e09ece0"}
Nov 04 01:18:33.102438 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:33.102400    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j" event={"ID":"d30ea1fb-032a-4d84-9c4e-dd1f725b83e9","Type":"ContainerStarted","Data":"f67f6ca38753e4fbbf2ba6264e6190ab37e6a9a1c854272497f6e39ba9ed7f07"}
Nov 04 01:18:33.102899 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:33.102496    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"
Nov 04 01:18:33.362406 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:33.362351    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j" podStartSLOduration=2.421991924 podStartE2EDuration="7.362336544s" totalImagesPullingTime="4.531394138s" totalInitContainerRuntime="408.950482ms" isStatefulPod=false podCreationTimestamp="2026-11-04 01:18:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:18:33.356810871 +0000 UTC m=+435.909270998" watchObservedRunningTime="2026-11-04 01:18:33.362336544 +0000 UTC m=+435.914796668"
Nov 04 01:18:41.141190 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:18:41.141143    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:18:44.108002 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:44.107958    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-v842j"
Nov 04 01:18:56.743878 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:56.743845    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-djfnz"]
Nov 04 01:18:56.748086 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:56.748055    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-djfnz"
Nov 04 01:18:56.801716 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:56.801687    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-djfnz"]
Nov 04 01:18:56.852845 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:56.852812    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Nov 04 01:18:56.852845 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:56.852830    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6m5vf\""
Nov 04 01:18:56.852845 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:56.852831    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Nov 04 01:18:56.889870 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:56.889839    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8ndr\" (UniqueName: \"kubernetes.io/projected/3c20ba45-017b-4dd6-99aa-4cf5e2954846-kube-api-access-w8ndr\") pod \"cert-manager-cainjector-5c57bbd4fc-djfnz\" (UID: \"3c20ba45-017b-4dd6-99aa-4cf5e2954846\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-djfnz"
Nov 04 01:18:56.890038 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:56.889880    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c20ba45-017b-4dd6-99aa-4cf5e2954846-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-djfnz\" (UID: \"3c20ba45-017b-4dd6-99aa-4cf5e2954846\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-djfnz"
Nov 04 01:18:56.990981 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:56.990938    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8ndr\" (UniqueName: \"kubernetes.io/projected/3c20ba45-017b-4dd6-99aa-4cf5e2954846-kube-api-access-w8ndr\") pod \"cert-manager-cainjector-5c57bbd4fc-djfnz\" (UID: \"3c20ba45-017b-4dd6-99aa-4cf5e2954846\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-djfnz"
Nov 04 01:18:56.991139 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:56.990994    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c20ba45-017b-4dd6-99aa-4cf5e2954846-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-djfnz\" (UID: \"3c20ba45-017b-4dd6-99aa-4cf5e2954846\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-djfnz"
Nov 04 01:18:57.053365 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:57.053330    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c20ba45-017b-4dd6-99aa-4cf5e2954846-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-djfnz\" (UID: \"3c20ba45-017b-4dd6-99aa-4cf5e2954846\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-djfnz"
Nov 04 01:18:57.053796 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:57.053778    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8ndr\" (UniqueName: \"kubernetes.io/projected/3c20ba45-017b-4dd6-99aa-4cf5e2954846-kube-api-access-w8ndr\") pod \"cert-manager-cainjector-5c57bbd4fc-djfnz\" (UID: \"3c20ba45-017b-4dd6-99aa-4cf5e2954846\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-djfnz"
Nov 04 01:18:57.065658 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:57.065633    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-djfnz"
Nov 04 01:18:57.434185 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:57.434157    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-djfnz"]
Nov 04 01:18:57.436396 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:18:57.436364    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c20ba45_017b_4dd6_99aa_4cf5e2954846.slice/crio-371be9c6c37e2e175ec55d740f83d5c173ea9ebed98e99fc507e39129e4c470a WatchSource:0}: Error finding container 371be9c6c37e2e175ec55d740f83d5c173ea9ebed98e99fc507e39129e4c470a: Status 404 returned error can't find the container with id 371be9c6c37e2e175ec55d740f83d5c173ea9ebed98e99fc507e39129e4c470a
Nov 04 01:18:58.192354 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:18:58.192322    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-djfnz" event={"ID":"3c20ba45-017b-4dd6-99aa-4cf5e2954846","Type":"ContainerStarted","Data":"371be9c6c37e2e175ec55d740f83d5c173ea9ebed98e99fc507e39129e4c470a"}
Nov 04 01:19:02.210944 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:02.210902    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-djfnz" event={"ID":"3c20ba45-017b-4dd6-99aa-4cf5e2954846","Type":"ContainerStarted","Data":"7e4c5f5bdcd78637ce0a96f78298b2a14f2da423d6386186414604c8e8c8eb12"}
Nov 04 01:19:02.330952 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:02.330888    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-djfnz" podStartSLOduration=2.1847032459999998 podStartE2EDuration="6.330869257s" totalImagesPullingTime="4.146166011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:18:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:19:02.330208716 +0000 UTC m=+464.882668868" watchObservedRunningTime="2026-11-04 01:19:02.330869257 +0000 UTC m=+464.883329385"
Nov 04 01:19:07.873658 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:07.873622    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-flqz4"]
Nov 04 01:19:07.879954 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:07.879932    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-flqz4"
Nov 04 01:19:07.985020 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:07.984989    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wwbr\" (UniqueName: \"kubernetes.io/projected/91a53905-eabd-4622-b036-860811506079-kube-api-access-9wwbr\") pod \"jobset-operator-674cd59dc5-flqz4\" (UID: \"91a53905-eabd-4622-b036-860811506079\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-flqz4"
Nov 04 01:19:07.985160 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:07.985042    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91a53905-eabd-4622-b036-860811506079-tmp\") pod \"jobset-operator-674cd59dc5-flqz4\" (UID: \"91a53905-eabd-4622-b036-860811506079\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-flqz4"
Nov 04 01:19:07.987436 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:07.987410    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Nov 04 01:19:07.987436 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:07.987411    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-q7295\""
Nov 04 01:19:07.987594 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:07.987442    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Nov 04 01:19:07.988234 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:07.988217    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-flqz4"]
Nov 04 01:19:08.085673 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:08.085625    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wwbr\" (UniqueName: \"kubernetes.io/projected/91a53905-eabd-4622-b036-860811506079-kube-api-access-9wwbr\") pod \"jobset-operator-674cd59dc5-flqz4\" (UID: \"91a53905-eabd-4622-b036-860811506079\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-flqz4"
Nov 04 01:19:08.085841 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:08.085783    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91a53905-eabd-4622-b036-860811506079-tmp\") pod \"jobset-operator-674cd59dc5-flqz4\" (UID: \"91a53905-eabd-4622-b036-860811506079\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-flqz4"
Nov 04 01:19:08.086208 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:08.086170    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91a53905-eabd-4622-b036-860811506079-tmp\") pod \"jobset-operator-674cd59dc5-flqz4\" (UID: \"91a53905-eabd-4622-b036-860811506079\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-flqz4"
Nov 04 01:19:08.158703 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:08.158618    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wwbr\" (UniqueName: \"kubernetes.io/projected/91a53905-eabd-4622-b036-860811506079-kube-api-access-9wwbr\") pod \"jobset-operator-674cd59dc5-flqz4\" (UID: \"91a53905-eabd-4622-b036-860811506079\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-flqz4"
Nov 04 01:19:08.190056 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:08.190030    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-flqz4"
Nov 04 01:19:08.560982 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:08.560945    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-flqz4"]
Nov 04 01:19:08.563271 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:19:08.563240    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91a53905_eabd_4622_b036_860811506079.slice/crio-51a0781def3da1b10bf37f621667cebd75f89aa929e97737436f6962444f2788 WatchSource:0}: Error finding container 51a0781def3da1b10bf37f621667cebd75f89aa929e97737436f6962444f2788: Status 404 returned error can't find the container with id 51a0781def3da1b10bf37f621667cebd75f89aa929e97737436f6962444f2788
Nov 04 01:19:09.238683 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:09.238638    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-flqz4" event={"ID":"91a53905-eabd-4622-b036-860811506079","Type":"ContainerStarted","Data":"51a0781def3da1b10bf37f621667cebd75f89aa929e97737436f6962444f2788"}
Nov 04 01:19:11.147253 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:19:11.147216    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:19:13.257205 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:13.257168    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-flqz4" event={"ID":"91a53905-eabd-4622-b036-860811506079","Type":"ContainerStarted","Data":"6c93f4b847120ff995d8de151a629f4582ca8475e44d51630505f6c84dec0a80"}
Nov 04 01:19:13.375611 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:13.375560    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-flqz4" podStartSLOduration=2.183859646 podStartE2EDuration="6.375547181s" totalImagesPullingTime="4.191687535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:19:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:19:13.375159408 +0000 UTC m=+475.927619532" watchObservedRunningTime="2026-11-04 01:19:13.375547181 +0000 UTC m=+475.928007305"
Nov 04 01:19:26.398101 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:26.398066    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-54cfc47d9b-6g2fd"]
Nov 04 01:19:26.402783 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:26.402763    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54cfc47d9b-6g2fd"
Nov 04 01:19:26.437046 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:26.437020    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gltcw\" (UniqueName: \"kubernetes.io/projected/f8b532d4-d727-4efb-8412-a8dc2ec308e3-kube-api-access-gltcw\") pod \"kube-auth-proxy-54cfc47d9b-6g2fd\" (UID: \"f8b532d4-d727-4efb-8412-a8dc2ec308e3\") " pod="openshift-ingress/kube-auth-proxy-54cfc47d9b-6g2fd"
Nov 04 01:19:26.437157 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:26.437098    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8b532d4-d727-4efb-8412-a8dc2ec308e3-tmp\") pod \"kube-auth-proxy-54cfc47d9b-6g2fd\" (UID: \"f8b532d4-d727-4efb-8412-a8dc2ec308e3\") " pod="openshift-ingress/kube-auth-proxy-54cfc47d9b-6g2fd"
Nov 04 01:19:26.437208 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:26.437188    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8b532d4-d727-4efb-8412-a8dc2ec308e3-tls-certs\") pod \"kube-auth-proxy-54cfc47d9b-6g2fd\" (UID: \"f8b532d4-d727-4efb-8412-a8dc2ec308e3\") " pod="openshift-ingress/kube-auth-proxy-54cfc47d9b-6g2fd"
Nov 04 01:19:26.509023 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:26.508981    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Nov 04 01:19:26.509023 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:26.509009    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qszhl\""
Nov 04 01:19:26.509168 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:26.509094    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Nov 04 01:19:26.509903 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:26.509884    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54cfc47d9b-6g2fd"]
Nov 04 01:19:26.537561 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:26.537540    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gltcw\" (UniqueName: \"kubernetes.io/projected/f8b532d4-d727-4efb-8412-a8dc2ec308e3-kube-api-access-gltcw\") pod \"kube-auth-proxy-54cfc47d9b-6g2fd\" (UID: \"f8b532d4-d727-4efb-8412-a8dc2ec308e3\") " pod="openshift-ingress/kube-auth-proxy-54cfc47d9b-6g2fd"
Nov 04 01:19:26.537666 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:26.537588    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8b532d4-d727-4efb-8412-a8dc2ec308e3-tmp\") pod \"kube-auth-proxy-54cfc47d9b-6g2fd\" (UID: \"f8b532d4-d727-4efb-8412-a8dc2ec308e3\") " pod="openshift-ingress/kube-auth-proxy-54cfc47d9b-6g2fd"
Nov 04 01:19:26.537726 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:26.537710    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8b532d4-d727-4efb-8412-a8dc2ec308e3-tls-certs\") pod \"kube-auth-proxy-54cfc47d9b-6g2fd\" (UID: \"f8b532d4-d727-4efb-8412-a8dc2ec308e3\") " pod="openshift-ingress/kube-auth-proxy-54cfc47d9b-6g2fd"
Nov 04 01:19:26.539985 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:26.539951    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8b532d4-d727-4efb-8412-a8dc2ec308e3-tmp\") pod \"kube-auth-proxy-54cfc47d9b-6g2fd\" (UID: \"f8b532d4-d727-4efb-8412-a8dc2ec308e3\") " pod="openshift-ingress/kube-auth-proxy-54cfc47d9b-6g2fd"
Nov 04 01:19:26.540158 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:26.540139    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8b532d4-d727-4efb-8412-a8dc2ec308e3-tls-certs\") pod \"kube-auth-proxy-54cfc47d9b-6g2fd\" (UID: \"f8b532d4-d727-4efb-8412-a8dc2ec308e3\") " pod="openshift-ingress/kube-auth-proxy-54cfc47d9b-6g2fd"
Nov 04 01:19:26.600021 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:26.599995    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gltcw\" (UniqueName: \"kubernetes.io/projected/f8b532d4-d727-4efb-8412-a8dc2ec308e3-kube-api-access-gltcw\") pod \"kube-auth-proxy-54cfc47d9b-6g2fd\" (UID: \"f8b532d4-d727-4efb-8412-a8dc2ec308e3\") " pod="openshift-ingress/kube-auth-proxy-54cfc47d9b-6g2fd"
Nov 04 01:19:26.715937 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:26.715877    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54cfc47d9b-6g2fd"
Nov 04 01:19:27.091094 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:27.091072    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54cfc47d9b-6g2fd"]
Nov 04 01:19:27.092995 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:19:27.092958    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8b532d4_d727_4efb_8412_a8dc2ec308e3.slice/crio-f3886d06747e58bb225e3c4ec6ff6e22ffe415fed814042c6389175433de406b WatchSource:0}: Error finding container f3886d06747e58bb225e3c4ec6ff6e22ffe415fed814042c6389175433de406b: Status 404 returned error can't find the container with id f3886d06747e58bb225e3c4ec6ff6e22ffe415fed814042c6389175433de406b
Nov 04 01:19:27.312962 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:27.312934    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54cfc47d9b-6g2fd" event={"ID":"f8b532d4-d727-4efb-8412-a8dc2ec308e3","Type":"ContainerStarted","Data":"f3886d06747e58bb225e3c4ec6ff6e22ffe415fed814042c6389175433de406b"}
Nov 04 01:19:31.336195 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:31.336156    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54cfc47d9b-6g2fd" event={"ID":"f8b532d4-d727-4efb-8412-a8dc2ec308e3","Type":"ContainerStarted","Data":"e7686076da5a3d1eb2d9b2f7ea9a2ad2dcc78bd6668feba8900a6a08eff67cde"}
Nov 04 01:19:31.455859 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:31.455796    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-54cfc47d9b-6g2fd" podStartSLOduration=2.179221411 podStartE2EDuration="5.455781818s" totalImagesPullingTime="3.276560407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:19:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:19:31.454871409 +0000 UTC m=+494.007331558" watchObservedRunningTime="2026-11-04 01:19:31.455781818 +0000 UTC m=+494.008241946"
Nov 04 01:19:31.739184 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:31.739110    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-55d4cc59f-nt2bd"]
Nov 04 01:19:31.742403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:31.742384    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-55d4cc59f-nt2bd"
Nov 04 01:19:31.780458 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:31.780432    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4defb51-74db-40ea-8b9c-7803c1d6e577-cert\") pod \"jobset-controller-manager-55d4cc59f-nt2bd\" (UID: \"f4defb51-74db-40ea-8b9c-7803c1d6e577\") " pod="openshift-jobset-operator/jobset-controller-manager-55d4cc59f-nt2bd"
Nov 04 01:19:31.780554 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:31.780476    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f4defb51-74db-40ea-8b9c-7803c1d6e577-manager-config\") pod \"jobset-controller-manager-55d4cc59f-nt2bd\" (UID: \"f4defb51-74db-40ea-8b9c-7803c1d6e577\") " pod="openshift-jobset-operator/jobset-controller-manager-55d4cc59f-nt2bd"
Nov 04 01:19:31.780610 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:31.780581    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjtb4\" (UniqueName: \"kubernetes.io/projected/f4defb51-74db-40ea-8b9c-7803c1d6e577-kube-api-access-zjtb4\") pod \"jobset-controller-manager-55d4cc59f-nt2bd\" (UID: \"f4defb51-74db-40ea-8b9c-7803c1d6e577\") " pod="openshift-jobset-operator/jobset-controller-manager-55d4cc59f-nt2bd"
Nov 04 01:19:31.780652 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:31.780613    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4defb51-74db-40ea-8b9c-7803c1d6e577-metrics-certs\") pod \"jobset-controller-manager-55d4cc59f-nt2bd\" (UID: \"f4defb51-74db-40ea-8b9c-7803c1d6e577\") " pod="openshift-jobset-operator/jobset-controller-manager-55d4cc59f-nt2bd"
Nov 04 01:19:31.796642 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:31.796595    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-55d4cc59f-nt2bd"]
Nov 04 01:19:31.847288 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:31.847266    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\""
Nov 04 01:19:31.847288 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:31.847277    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-bz6m5\""
Nov 04 01:19:31.847410 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:31.847389    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\""
Nov 04 01:19:31.878400 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:31.878379    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\""
Nov 04 01:19:31.881671 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:31.881652    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjtb4\" (UniqueName: \"kubernetes.io/projected/f4defb51-74db-40ea-8b9c-7803c1d6e577-kube-api-access-zjtb4\") pod \"jobset-controller-manager-55d4cc59f-nt2bd\" (UID: \"f4defb51-74db-40ea-8b9c-7803c1d6e577\") " pod="openshift-jobset-operator/jobset-controller-manager-55d4cc59f-nt2bd"
Nov 04 01:19:31.881729 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:31.881683    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4defb51-74db-40ea-8b9c-7803c1d6e577-metrics-certs\") pod \"jobset-controller-manager-55d4cc59f-nt2bd\" (UID: \"f4defb51-74db-40ea-8b9c-7803c1d6e577\") " pod="openshift-jobset-operator/jobset-controller-manager-55d4cc59f-nt2bd"
Nov 04 01:19:31.881729 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:31.881709    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4defb51-74db-40ea-8b9c-7803c1d6e577-cert\") pod \"jobset-controller-manager-55d4cc59f-nt2bd\" (UID: \"f4defb51-74db-40ea-8b9c-7803c1d6e577\") " pod="openshift-jobset-operator/jobset-controller-manager-55d4cc59f-nt2bd"
Nov 04 01:19:31.881808 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:31.881751    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f4defb51-74db-40ea-8b9c-7803c1d6e577-manager-config\") pod \"jobset-controller-manager-55d4cc59f-nt2bd\" (UID: \"f4defb51-74db-40ea-8b9c-7803c1d6e577\") " pod="openshift-jobset-operator/jobset-controller-manager-55d4cc59f-nt2bd"
Nov 04 01:19:31.882459 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:31.882438    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f4defb51-74db-40ea-8b9c-7803c1d6e577-manager-config\") pod \"jobset-controller-manager-55d4cc59f-nt2bd\" (UID: \"f4defb51-74db-40ea-8b9c-7803c1d6e577\") " pod="openshift-jobset-operator/jobset-controller-manager-55d4cc59f-nt2bd"
Nov 04 01:19:31.884086 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:31.884064    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4defb51-74db-40ea-8b9c-7803c1d6e577-metrics-certs\") pod \"jobset-controller-manager-55d4cc59f-nt2bd\" (UID: \"f4defb51-74db-40ea-8b9c-7803c1d6e577\") " pod="openshift-jobset-operator/jobset-controller-manager-55d4cc59f-nt2bd"
Nov 04 01:19:31.884179 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:31.884162    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4defb51-74db-40ea-8b9c-7803c1d6e577-cert\") pod \"jobset-controller-manager-55d4cc59f-nt2bd\" (UID: \"f4defb51-74db-40ea-8b9c-7803c1d6e577\") " pod="openshift-jobset-operator/jobset-controller-manager-55d4cc59f-nt2bd"
Nov 04 01:19:31.943450 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:31.943425    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjtb4\" (UniqueName: \"kubernetes.io/projected/f4defb51-74db-40ea-8b9c-7803c1d6e577-kube-api-access-zjtb4\") pod \"jobset-controller-manager-55d4cc59f-nt2bd\" (UID: \"f4defb51-74db-40ea-8b9c-7803c1d6e577\") " pod="openshift-jobset-operator/jobset-controller-manager-55d4cc59f-nt2bd"
Nov 04 01:19:32.054504 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:32.054478    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-55d4cc59f-nt2bd"
Nov 04 01:19:32.430067 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:32.430008    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-55d4cc59f-nt2bd"]
Nov 04 01:19:32.432085 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:19:32.432058    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4defb51_74db_40ea_8b9c_7803c1d6e577.slice/crio-8ed864bdfc1d19c7e45f785ce37b94fc6e899c7980652223ef05e2042b66ae1d WatchSource:0}: Error finding container 8ed864bdfc1d19c7e45f785ce37b94fc6e899c7980652223ef05e2042b66ae1d: Status 404 returned error can't find the container with id 8ed864bdfc1d19c7e45f785ce37b94fc6e899c7980652223ef05e2042b66ae1d
Nov 04 01:19:33.345276 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:33.345245    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-55d4cc59f-nt2bd" event={"ID":"f4defb51-74db-40ea-8b9c-7803c1d6e577","Type":"ContainerStarted","Data":"8ed864bdfc1d19c7e45f785ce37b94fc6e899c7980652223ef05e2042b66ae1d"}
Nov 04 01:19:37.375159 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:37.375117    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-55d4cc59f-nt2bd" event={"ID":"f4defb51-74db-40ea-8b9c-7803c1d6e577","Type":"ContainerStarted","Data":"dc20d64e97154efa160b60826a24391523b364f1b47032b89b514b0c596533c1"}
Nov 04 01:19:37.375550 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:37.375235    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-55d4cc59f-nt2bd"
Nov 04 01:19:37.494450 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:37.494404    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-55d4cc59f-nt2bd" podStartSLOduration=1.979754665 podStartE2EDuration="6.494390357s" totalImagesPullingTime="4.514635692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:19:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:19:37.494089552 +0000 UTC m=+500.046549701" watchObservedRunningTime="2026-11-04 01:19:37.494390357 +0000 UTC m=+500.046850483"
Nov 04 01:19:41.140339 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:19:41.140302    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:19:48.384806 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:19:48.384775    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-55d4cc59f-nt2bd"
Nov 04 01:20:11.139527 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:20:11.139486    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:20:41.139658 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:20:41.139615    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:21:06.254748 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.254715    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"]
Nov 04 01:21:06.255164 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.254935    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b" podUID="c5296344-7037-41f8-8455-80afec73c555" containerName="discovery" containerID="cri-o://477814b04b06f2d6ddbd3377adc5537dfec0c56ec9b10997091610413a379421" gracePeriod=30
Nov 04 01:21:06.491595 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.491571    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:21:06.581785 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.581763    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5296344-7037-41f8-8455-80afec73c555-kube-api-access-cfqvp\" (UniqueName: \"kubernetes.io/projected/c5296344-7037-41f8-8455-80afec73c555-kube-api-access-cfqvp\") pod \"c5296344-7037-41f8-8455-80afec73c555\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") "
Nov 04 01:21:06.581892 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.581800    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5296344-7037-41f8-8455-80afec73c555-istio-token\" (UniqueName: \"kubernetes.io/projected/c5296344-7037-41f8-8455-80afec73c555-istio-token\") pod \"c5296344-7037-41f8-8455-80afec73c555\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") "
Nov 04 01:21:06.581892 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.581827    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c5296344-7037-41f8-8455-80afec73c555-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5296344-7037-41f8-8455-80afec73c555-istio-csr-ca-configmap\") pod \"c5296344-7037-41f8-8455-80afec73c555\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") "
Nov 04 01:21:06.581892 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.581872    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c5296344-7037-41f8-8455-80afec73c555-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5296344-7037-41f8-8455-80afec73c555-istio-kubeconfig\") pod \"c5296344-7037-41f8-8455-80afec73c555\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") "
Nov 04 01:21:06.582053 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.581906    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5296344-7037-41f8-8455-80afec73c555-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5296344-7037-41f8-8455-80afec73c555-local-certs\") pod \"c5296344-7037-41f8-8455-80afec73c555\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") "
Nov 04 01:21:06.582053 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.581941    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c5296344-7037-41f8-8455-80afec73c555-cacerts\" (UniqueName: \"kubernetes.io/secret/c5296344-7037-41f8-8455-80afec73c555-cacerts\") pod \"c5296344-7037-41f8-8455-80afec73c555\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") "
Nov 04 01:21:06.582157 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.582049    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c5296344-7037-41f8-8455-80afec73c555-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5296344-7037-41f8-8455-80afec73c555-istio-csr-dns-cert\") pod \"c5296344-7037-41f8-8455-80afec73c555\" (UID: \"c5296344-7037-41f8-8455-80afec73c555\") "
Nov 04 01:21:06.582320 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.582280    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5296344-7037-41f8-8455-80afec73c555-istio-csr-ca-configmap" pod "c5296344-7037-41f8-8455-80afec73c555" (UID: "c5296344-7037-41f8-8455-80afec73c555"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:21:06.584150 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.584122    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5296344-7037-41f8-8455-80afec73c555-istio-kubeconfig" pod "c5296344-7037-41f8-8455-80afec73c555" (UID: "c5296344-7037-41f8-8455-80afec73c555"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:21:06.584275 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.584172    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5296344-7037-41f8-8455-80afec73c555-kube-api-access-cfqvp" pod "c5296344-7037-41f8-8455-80afec73c555" (UID: "c5296344-7037-41f8-8455-80afec73c555"). InnerVolumeSpecName "kube-api-access-cfqvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:21:06.584345 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.584304    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5296344-7037-41f8-8455-80afec73c555-istio-token" pod "c5296344-7037-41f8-8455-80afec73c555" (UID: "c5296344-7037-41f8-8455-80afec73c555"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:21:06.584403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.584388    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5296344-7037-41f8-8455-80afec73c555-cacerts" pod "c5296344-7037-41f8-8455-80afec73c555" (UID: "c5296344-7037-41f8-8455-80afec73c555"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:21:06.584525 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.584506    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5296344-7037-41f8-8455-80afec73c555-istio-csr-dns-cert" pod "c5296344-7037-41f8-8455-80afec73c555" (UID: "c5296344-7037-41f8-8455-80afec73c555"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:21:06.584562 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.584531    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5296344-7037-41f8-8455-80afec73c555-local-certs" pod "c5296344-7037-41f8-8455-80afec73c555" (UID: "c5296344-7037-41f8-8455-80afec73c555"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:21:06.683591 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.683564    5640 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5296344-7037-41f8-8455-80afec73c555-istio-csr-ca-configmap\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:21:06.683591 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.683588    5640 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5296344-7037-41f8-8455-80afec73c555-istio-kubeconfig\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:21:06.683727 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.683598    5640 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5296344-7037-41f8-8455-80afec73c555-local-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:21:06.683727 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.683607    5640 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5296344-7037-41f8-8455-80afec73c555-cacerts\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:21:06.683727 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.683615    5640 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5296344-7037-41f8-8455-80afec73c555-istio-csr-dns-cert\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:21:06.683727 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.683622    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfqvp\" (UniqueName: \"kubernetes.io/projected/c5296344-7037-41f8-8455-80afec73c555-kube-api-access-cfqvp\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:21:06.683727 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.683631    5640 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5296344-7037-41f8-8455-80afec73c555-istio-token\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:21:06.731192 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.731170    5640 generic.go:356] "Generic (PLEG): container finished" podID="c5296344-7037-41f8-8455-80afec73c555" containerID="477814b04b06f2d6ddbd3377adc5537dfec0c56ec9b10997091610413a379421" exitCode=0
Nov 04 01:21:06.731310 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.731202    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b" event={"ID":"c5296344-7037-41f8-8455-80afec73c555","Type":"ContainerDied","Data":"477814b04b06f2d6ddbd3377adc5537dfec0c56ec9b10997091610413a379421"}
Nov 04 01:21:06.731310 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.731211    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"
Nov 04 01:21:06.731310 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.731233    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b" event={"ID":"c5296344-7037-41f8-8455-80afec73c555","Type":"ContainerDied","Data":"ab95e2c1c4e95404ea40ab63a28490b20a0b9c4dd80927d0aeea5817a40ab2c4"}
Nov 04 01:21:06.731310 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.731257    5640 scope.go:122] "RemoveContainer" containerID="477814b04b06f2d6ddbd3377adc5537dfec0c56ec9b10997091610413a379421"
Nov 04 01:21:06.739819 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.739796    5640 scope.go:122] "RemoveContainer" containerID="477814b04b06f2d6ddbd3377adc5537dfec0c56ec9b10997091610413a379421"
Nov 04 01:21:06.740115 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:21:06.740098    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"477814b04b06f2d6ddbd3377adc5537dfec0c56ec9b10997091610413a379421\": container with ID starting with 477814b04b06f2d6ddbd3377adc5537dfec0c56ec9b10997091610413a379421 not found: ID does not exist" containerID="477814b04b06f2d6ddbd3377adc5537dfec0c56ec9b10997091610413a379421"
Nov 04 01:21:06.740191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.740121    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"477814b04b06f2d6ddbd3377adc5537dfec0c56ec9b10997091610413a379421"} err="failed to get container status \"477814b04b06f2d6ddbd3377adc5537dfec0c56ec9b10997091610413a379421\": rpc error: code = NotFound desc = could not find container \"477814b04b06f2d6ddbd3377adc5537dfec0c56ec9b10997091610413a379421\": container with ID starting with 477814b04b06f2d6ddbd3377adc5537dfec0c56ec9b10997091610413a379421 not found: ID does not exist"
Nov 04 01:21:06.900000 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.899950    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"]
Nov 04 01:21:06.906813 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:06.906791    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-p567b"]
Nov 04 01:21:07.562882 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:07.562858    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c5296344-7037-41f8-8455-80afec73c555" path="/var/lib/kubelet/pods/c5296344-7037-41f8-8455-80afec73c555/volumes"
Nov 04 01:21:11.140321 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:21:11.140282    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:21:13.367039 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.367002    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-ghspq"]
Nov 04 01:21:13.367482 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.367309    5640 cpu_manager.go:414] "containerMap: removing container" podUID="c5296344-7037-41f8-8455-80afec73c555" containerName="discovery"
Nov 04 01:21:13.367482 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.367319    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c5296344-7037-41f8-8455-80afec73c555" containerName="discovery"
Nov 04 01:21:13.367482 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.367375    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="c5296344-7037-41f8-8455-80afec73c555" containerName="discovery"
Nov 04 01:21:13.371358 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.371339    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-ghspq"
Nov 04 01:21:13.422782 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.422761    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-ghspq"]
Nov 04 01:21:13.428753 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.428733    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k49fw\" (UniqueName: \"kubernetes.io/projected/80564d05-3c8a-4a95-9251-747a1914dcca-kube-api-access-k49fw\") pod \"authorino-6f6944bcdd-ghspq\" (UID: \"80564d05-3c8a-4a95-9251-747a1914dcca\") " pod="kuadrant-system/authorino-6f6944bcdd-ghspq"
Nov 04 01:21:13.473629 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.473609    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nbnlf\""
Nov 04 01:21:13.502554 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.502535    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Nov 04 01:21:13.502554 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.502537    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Nov 04 01:21:13.529150 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.529131    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k49fw\" (UniqueName: \"kubernetes.io/projected/80564d05-3c8a-4a95-9251-747a1914dcca-kube-api-access-k49fw\") pod \"authorino-6f6944bcdd-ghspq\" (UID: \"80564d05-3c8a-4a95-9251-747a1914dcca\") " pod="kuadrant-system/authorino-6f6944bcdd-ghspq"
Nov 04 01:21:13.572158 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.572133    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-59b874c49c-hvkkd"]
Nov 04 01:21:13.575493 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.575478    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59b874c49c-hvkkd"
Nov 04 01:21:13.591681 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.591656    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k49fw\" (UniqueName: \"kubernetes.io/projected/80564d05-3c8a-4a95-9251-747a1914dcca-kube-api-access-k49fw\") pod \"authorino-6f6944bcdd-ghspq\" (UID: \"80564d05-3c8a-4a95-9251-747a1914dcca\") " pod="kuadrant-system/authorino-6f6944bcdd-ghspq"
Nov 04 01:21:13.630302 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.630240    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sltpc\" (UniqueName: \"kubernetes.io/projected/a892880f-4481-4037-aa61-57626bd6afe5-kube-api-access-sltpc\") pod \"maas-api-59b874c49c-hvkkd\" (UID: \"a892880f-4481-4037-aa61-57626bd6afe5\") " pod="odh-ai-gateway-infra/maas-api-59b874c49c-hvkkd"
Nov 04 01:21:13.630302 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.630280    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a892880f-4481-4037-aa61-57626bd6afe5-maas-api-tls\") pod \"maas-api-59b874c49c-hvkkd\" (UID: \"a892880f-4481-4037-aa61-57626bd6afe5\") " pod="odh-ai-gateway-infra/maas-api-59b874c49c-hvkkd"
Nov 04 01:21:13.630302 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.630300    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a892880f-4481-4037-aa61-57626bd6afe5-openshift-service-ca\") pod \"maas-api-59b874c49c-hvkkd\" (UID: \"a892880f-4481-4037-aa61-57626bd6afe5\") " pod="odh-ai-gateway-infra/maas-api-59b874c49c-hvkkd"
Nov 04 01:21:13.630522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.630435    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a892880f-4481-4037-aa61-57626bd6afe5-metrics-certs\") pod \"maas-api-59b874c49c-hvkkd\" (UID: \"a892880f-4481-4037-aa61-57626bd6afe5\") " pod="odh-ai-gateway-infra/maas-api-59b874c49c-hvkkd"
Nov 04 01:21:13.631002 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.630961    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 01:21:13.631684 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.631659    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 01:21:13.631803 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.631784    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 04 01:21:13.631952 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.631785    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jfk6s\""
Nov 04 01:21:13.631952 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.631852    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Nov 04 01:21:13.632640 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.632618    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59b874c49c-hvkkd"]
Nov 04 01:21:13.681871 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.681845    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-ghspq"
Nov 04 01:21:13.734520 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.731901    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sltpc\" (UniqueName: \"kubernetes.io/projected/a892880f-4481-4037-aa61-57626bd6afe5-kube-api-access-sltpc\") pod \"maas-api-59b874c49c-hvkkd\" (UID: \"a892880f-4481-4037-aa61-57626bd6afe5\") " pod="odh-ai-gateway-infra/maas-api-59b874c49c-hvkkd"
Nov 04 01:21:13.734520 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.731959    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a892880f-4481-4037-aa61-57626bd6afe5-maas-api-tls\") pod \"maas-api-59b874c49c-hvkkd\" (UID: \"a892880f-4481-4037-aa61-57626bd6afe5\") " pod="odh-ai-gateway-infra/maas-api-59b874c49c-hvkkd"
Nov 04 01:21:13.734520 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.732016    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a892880f-4481-4037-aa61-57626bd6afe5-openshift-service-ca\") pod \"maas-api-59b874c49c-hvkkd\" (UID: \"a892880f-4481-4037-aa61-57626bd6afe5\") " pod="odh-ai-gateway-infra/maas-api-59b874c49c-hvkkd"
Nov 04 01:21:13.734520 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.732045    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a892880f-4481-4037-aa61-57626bd6afe5-metrics-certs\") pod \"maas-api-59b874c49c-hvkkd\" (UID: \"a892880f-4481-4037-aa61-57626bd6afe5\") " pod="odh-ai-gateway-infra/maas-api-59b874c49c-hvkkd"
Nov 04 01:21:13.734520 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.732840    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a892880f-4481-4037-aa61-57626bd6afe5-openshift-service-ca\") pod \"maas-api-59b874c49c-hvkkd\" (UID: \"a892880f-4481-4037-aa61-57626bd6afe5\") " pod="odh-ai-gateway-infra/maas-api-59b874c49c-hvkkd"
Nov 04 01:21:13.735315 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.735291    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a892880f-4481-4037-aa61-57626bd6afe5-metrics-certs\") pod \"maas-api-59b874c49c-hvkkd\" (UID: \"a892880f-4481-4037-aa61-57626bd6afe5\") " pod="odh-ai-gateway-infra/maas-api-59b874c49c-hvkkd"
Nov 04 01:21:13.737674 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.737651    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a892880f-4481-4037-aa61-57626bd6afe5-maas-api-tls\") pod \"maas-api-59b874c49c-hvkkd\" (UID: \"a892880f-4481-4037-aa61-57626bd6afe5\") " pod="odh-ai-gateway-infra/maas-api-59b874c49c-hvkkd"
Nov 04 01:21:13.750588 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.750566    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-ghspq"]
Nov 04 01:21:13.789244 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.789216    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d7745c5b5-wcgxs"]
Nov 04 01:21:13.793492 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.793475    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d7745c5b5-wcgxs"
Nov 04 01:21:13.798908 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.798890    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sltpc\" (UniqueName: \"kubernetes.io/projected/a892880f-4481-4037-aa61-57626bd6afe5-kube-api-access-sltpc\") pod \"maas-api-59b874c49c-hvkkd\" (UID: \"a892880f-4481-4037-aa61-57626bd6afe5\") " pod="odh-ai-gateway-infra/maas-api-59b874c49c-hvkkd"
Nov 04 01:21:13.832929 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.832904    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62tzq\" (UniqueName: \"kubernetes.io/projected/36a9d3ec-9397-4e7b-8e94-0eff3088e27f-kube-api-access-62tzq\") pod \"authorino-7d7745c5b5-wcgxs\" (UID: \"36a9d3ec-9397-4e7b-8e94-0eff3088e27f\") " pod="kuadrant-system/authorino-7d7745c5b5-wcgxs"
Nov 04 01:21:13.846124 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.846103    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d7745c5b5-wcgxs"]
Nov 04 01:21:13.886755 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.886705    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59b874c49c-hvkkd"
Nov 04 01:21:13.933735 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.933706    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62tzq\" (UniqueName: \"kubernetes.io/projected/36a9d3ec-9397-4e7b-8e94-0eff3088e27f-kube-api-access-62tzq\") pod \"authorino-7d7745c5b5-wcgxs\" (UID: \"36a9d3ec-9397-4e7b-8e94-0eff3088e27f\") " pod="kuadrant-system/authorino-7d7745c5b5-wcgxs"
Nov 04 01:21:13.996201 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:13.996173    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62tzq\" (UniqueName: \"kubernetes.io/projected/36a9d3ec-9397-4e7b-8e94-0eff3088e27f-kube-api-access-62tzq\") pod \"authorino-7d7745c5b5-wcgxs\" (UID: \"36a9d3ec-9397-4e7b-8e94-0eff3088e27f\") " pod="kuadrant-system/authorino-7d7745c5b5-wcgxs"
Nov 04 01:21:14.052224 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:14.052192    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-ghspq"]
Nov 04 01:21:14.054464 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:21:14.054443    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80564d05_3c8a_4a95_9251_747a1914dcca.slice/crio-a148de124074cc620acfb7d2c1fbbcee83e27308ee6029a29a540760dc6ae5a3 WatchSource:0}: Error finding container a148de124074cc620acfb7d2c1fbbcee83e27308ee6029a29a540760dc6ae5a3: Status 404 returned error can't find the container with id a148de124074cc620acfb7d2c1fbbcee83e27308ee6029a29a540760dc6ae5a3
Nov 04 01:21:14.104863 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:14.104842    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d7745c5b5-wcgxs"
Nov 04 01:21:14.113338 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:14.113318    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d7745c5b5-wcgxs"]
Nov 04 01:21:14.146735 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:14.146662    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-cc745859-ntsd5"]
Nov 04 01:21:14.150319 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:14.150272    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cc745859-ntsd5"
Nov 04 01:21:14.203188 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:14.203162    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cc745859-ntsd5"]
Nov 04 01:21:14.204773 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:14.204755    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Nov 04 01:21:14.235833 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:14.235811    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68pc2\" (UniqueName: \"kubernetes.io/projected/a1019485-c563-4c94-a8d1-8272fecef8e7-kube-api-access-68pc2\") pod \"authorino-cc745859-ntsd5\" (UID: \"a1019485-c563-4c94-a8d1-8272fecef8e7\") " pod="kuadrant-system/authorino-cc745859-ntsd5"
Nov 04 01:21:14.235923 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:14.235857    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a1019485-c563-4c94-a8d1-8272fecef8e7-tls-cert\") pod \"authorino-cc745859-ntsd5\" (UID: \"a1019485-c563-4c94-a8d1-8272fecef8e7\") " pod="kuadrant-system/authorino-cc745859-ntsd5"
Nov 04 01:21:14.260938 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:14.260866    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59b874c49c-hvkkd"]
Nov 04 01:21:14.263120 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:21:14.263095    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda892880f_4481_4037_aa61_57626bd6afe5.slice/crio-eb48d846aac0f8855b11c3085a41b0566d3cbcc8e520ec8654d08075bff48a05 WatchSource:0}: Error finding container eb48d846aac0f8855b11c3085a41b0566d3cbcc8e520ec8654d08075bff48a05: Status 404 returned error can't find the container with id eb48d846aac0f8855b11c3085a41b0566d3cbcc8e520ec8654d08075bff48a05
Nov 04 01:21:14.337154 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:14.337132    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68pc2\" (UniqueName: \"kubernetes.io/projected/a1019485-c563-4c94-a8d1-8272fecef8e7-kube-api-access-68pc2\") pod \"authorino-cc745859-ntsd5\" (UID: \"a1019485-c563-4c94-a8d1-8272fecef8e7\") " pod="kuadrant-system/authorino-cc745859-ntsd5"
Nov 04 01:21:14.337251 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:14.337195    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a1019485-c563-4c94-a8d1-8272fecef8e7-tls-cert\") pod \"authorino-cc745859-ntsd5\" (UID: \"a1019485-c563-4c94-a8d1-8272fecef8e7\") " pod="kuadrant-system/authorino-cc745859-ntsd5"
Nov 04 01:21:14.339358 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:14.339335    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a1019485-c563-4c94-a8d1-8272fecef8e7-tls-cert\") pod \"authorino-cc745859-ntsd5\" (UID: \"a1019485-c563-4c94-a8d1-8272fecef8e7\") " pod="kuadrant-system/authorino-cc745859-ntsd5"
Nov 04 01:21:14.399778 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:14.399722    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68pc2\" (UniqueName: \"kubernetes.io/projected/a1019485-c563-4c94-a8d1-8272fecef8e7-kube-api-access-68pc2\") pod \"authorino-cc745859-ntsd5\" (UID: \"a1019485-c563-4c94-a8d1-8272fecef8e7\") " pod="kuadrant-system/authorino-cc745859-ntsd5"
Nov 04 01:21:14.464343 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:14.464319    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cc745859-ntsd5"
Nov 04 01:21:14.473811 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:14.473749    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d7745c5b5-wcgxs"]
Nov 04 01:21:14.476137 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:21:14.476012    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36a9d3ec_9397_4e7b_8e94_0eff3088e27f.slice/crio-e56ba055cacb5b59cd8d0c6082a3f68a5634093f4b51814d45abd18310a23335 WatchSource:0}: Error finding container e56ba055cacb5b59cd8d0c6082a3f68a5634093f4b51814d45abd18310a23335: Status 404 returned error can't find the container with id e56ba055cacb5b59cd8d0c6082a3f68a5634093f4b51814d45abd18310a23335
Nov 04 01:21:14.765403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:14.765326    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-ghspq" event={"ID":"80564d05-3c8a-4a95-9251-747a1914dcca","Type":"ContainerStarted","Data":"a148de124074cc620acfb7d2c1fbbcee83e27308ee6029a29a540760dc6ae5a3"}
Nov 04 01:21:14.766468 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:14.766444    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d7745c5b5-wcgxs" event={"ID":"36a9d3ec-9397-4e7b-8e94-0eff3088e27f","Type":"ContainerStarted","Data":"e56ba055cacb5b59cd8d0c6082a3f68a5634093f4b51814d45abd18310a23335"}
Nov 04 01:21:14.767690 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:14.767664    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59b874c49c-hvkkd" event={"ID":"a892880f-4481-4037-aa61-57626bd6afe5","Type":"ContainerStarted","Data":"eb48d846aac0f8855b11c3085a41b0566d3cbcc8e520ec8654d08075bff48a05"}
Nov 04 01:21:14.835559 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:14.835537    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cc745859-ntsd5"]
Nov 04 01:21:14.837231 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:21:14.837203    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1019485_c563_4c94_a8d1_8272fecef8e7.slice/crio-85e8cbc08e4881005801c835e81faed6ce472c9c9f6f35f4d544ad0e9f456675 WatchSource:0}: Error finding container 85e8cbc08e4881005801c835e81faed6ce472c9c9f6f35f4d544ad0e9f456675: Status 404 returned error can't find the container with id 85e8cbc08e4881005801c835e81faed6ce472c9c9f6f35f4d544ad0e9f456675
Nov 04 01:21:15.775178 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:15.775136    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cc745859-ntsd5" event={"ID":"a1019485-c563-4c94-a8d1-8272fecef8e7","Type":"ContainerStarted","Data":"85e8cbc08e4881005801c835e81faed6ce472c9c9f6f35f4d544ad0e9f456675"}
Nov 04 01:21:18.794599 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:18.794564    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59b874c49c-hvkkd" event={"ID":"a892880f-4481-4037-aa61-57626bd6afe5","Type":"ContainerStarted","Data":"d88efafc1db15079405f4468f62ca5cf844bfae0112fc781ce573cac7971c3e4"}
Nov 04 01:21:18.795330 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:18.795310    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-59b874c49c-hvkkd"
Nov 04 01:21:18.924047 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:18.920749    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-59b874c49c-hvkkd" podStartSLOduration=1.528723711 podStartE2EDuration="5.920730281s" totalImagesPullingTime="4.39200657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:21:18.919149982 +0000 UTC m=+601.471610108" watchObservedRunningTime="2026-11-04 01:21:18.920730281 +0000 UTC m=+601.473190409"
Nov 04 01:21:19.802254 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:19.802220    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cc745859-ntsd5" event={"ID":"a1019485-c563-4c94-a8d1-8272fecef8e7","Type":"ContainerStarted","Data":"618d0d3db7865c960fecbb9119601e3f8f2feb60cd3c11c9c88c6af7c3a4faed"}
Nov 04 01:21:19.804043 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:19.804015    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-ghspq" event={"ID":"80564d05-3c8a-4a95-9251-747a1914dcca","Type":"ContainerStarted","Data":"f62cfc376868e511b6d8d30a33d45b62c1184e4e7190d61370f4e973234253b8"}
Nov 04 01:21:19.804171 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:19.804060    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6f6944bcdd-ghspq" podUID="80564d05-3c8a-4a95-9251-747a1914dcca" containerName="authorino" containerID="cri-o://f62cfc376868e511b6d8d30a33d45b62c1184e4e7190d61370f4e973234253b8" gracePeriod=30
Nov 04 01:21:19.805720 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:19.805696    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d7745c5b5-wcgxs" event={"ID":"36a9d3ec-9397-4e7b-8e94-0eff3088e27f","Type":"ContainerStarted","Data":"6b855f52c8b433748e887562002365ac79b3c64d510974216e75532c6df91e0b"}
Nov 04 01:21:19.805828 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:19.805711    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-7d7745c5b5-wcgxs" podUID="36a9d3ec-9397-4e7b-8e94-0eff3088e27f" containerName="authorino" containerID="cri-o://6b855f52c8b433748e887562002365ac79b3c64d510974216e75532c6df91e0b" gracePeriod=30
Nov 04 01:21:19.923427 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:19.923375    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-cc745859-ntsd5" podStartSLOduration=1.296315024 podStartE2EDuration="5.923361969s" totalImagesPullingTime="4.627046945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:21:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:21:19.922810042 +0000 UTC m=+602.475270168" watchObservedRunningTime="2026-11-04 01:21:19.923361969 +0000 UTC m=+602.475822094"
Nov 04 01:21:20.040621 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.040572    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6f6944bcdd-ghspq" podStartSLOduration=1.6226501340000001 podStartE2EDuration="7.040556716s" totalImagesPullingTime="5.417906582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:21:20.039561916 +0000 UTC m=+602.592022076" watchObservedRunningTime="2026-11-04 01:21:20.040556716 +0000 UTC m=+602.593016841"
Nov 04 01:21:20.072381 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.072353    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-ghspq"
Nov 04 01:21:20.074641 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.074625    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d7745c5b5-wcgxs"
Nov 04 01:21:20.157517 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.157461    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-7d7745c5b5-wcgxs" podStartSLOduration=2.5076451 podStartE2EDuration="7.157444134s" totalImagesPullingTime="4.649799034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:21:20.156526817 +0000 UTC m=+602.708986964" watchObservedRunningTime="2026-11-04 01:21:20.157444134 +0000 UTC m=+602.709904263"
Nov 04 01:21:20.188775 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.188748    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36a9d3ec-9397-4e7b-8e94-0eff3088e27f-kube-api-access-62tzq\" (UniqueName: \"kubernetes.io/projected/36a9d3ec-9397-4e7b-8e94-0eff3088e27f-kube-api-access-62tzq\") pod \"36a9d3ec-9397-4e7b-8e94-0eff3088e27f\" (UID: \"36a9d3ec-9397-4e7b-8e94-0eff3088e27f\") "
Nov 04 01:21:20.188775 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.188779    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/80564d05-3c8a-4a95-9251-747a1914dcca-kube-api-access-k49fw\" (UniqueName: \"kubernetes.io/projected/80564d05-3c8a-4a95-9251-747a1914dcca-kube-api-access-k49fw\") pod \"80564d05-3c8a-4a95-9251-747a1914dcca\" (UID: \"80564d05-3c8a-4a95-9251-747a1914dcca\") "
Nov 04 01:21:20.191003 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.190946    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36a9d3ec-9397-4e7b-8e94-0eff3088e27f-kube-api-access-62tzq" pod "36a9d3ec-9397-4e7b-8e94-0eff3088e27f" (UID: "36a9d3ec-9397-4e7b-8e94-0eff3088e27f"). InnerVolumeSpecName "kube-api-access-62tzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:21:20.191112 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.191048    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80564d05-3c8a-4a95-9251-747a1914dcca-kube-api-access-k49fw" pod "80564d05-3c8a-4a95-9251-747a1914dcca" (UID: "80564d05-3c8a-4a95-9251-747a1914dcca"). InnerVolumeSpecName "kube-api-access-k49fw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:21:20.289880 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.289847    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62tzq\" (UniqueName: \"kubernetes.io/projected/36a9d3ec-9397-4e7b-8e94-0eff3088e27f-kube-api-access-62tzq\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:21:20.289880 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.289874    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k49fw\" (UniqueName: \"kubernetes.io/projected/80564d05-3c8a-4a95-9251-747a1914dcca-kube-api-access-k49fw\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:21:20.810947 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.810914    5640 generic.go:356] "Generic (PLEG): container finished" podID="80564d05-3c8a-4a95-9251-747a1914dcca" containerID="f62cfc376868e511b6d8d30a33d45b62c1184e4e7190d61370f4e973234253b8" exitCode=0
Nov 04 01:21:20.811367 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.810955    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-ghspq"
Nov 04 01:21:20.811367 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.811013    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-ghspq" event={"ID":"80564d05-3c8a-4a95-9251-747a1914dcca","Type":"ContainerDied","Data":"f62cfc376868e511b6d8d30a33d45b62c1184e4e7190d61370f4e973234253b8"}
Nov 04 01:21:20.811367 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.811052    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-ghspq" event={"ID":"80564d05-3c8a-4a95-9251-747a1914dcca","Type":"ContainerDied","Data":"a148de124074cc620acfb7d2c1fbbcee83e27308ee6029a29a540760dc6ae5a3"}
Nov 04 01:21:20.811367 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.811072    5640 scope.go:122] "RemoveContainer" containerID="f62cfc376868e511b6d8d30a33d45b62c1184e4e7190d61370f4e973234253b8"
Nov 04 01:21:20.812344 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.812251    5640 generic.go:356] "Generic (PLEG): container finished" podID="36a9d3ec-9397-4e7b-8e94-0eff3088e27f" containerID="6b855f52c8b433748e887562002365ac79b3c64d510974216e75532c6df91e0b" exitCode=0
Nov 04 01:21:20.812344 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.812280    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d7745c5b5-wcgxs" event={"ID":"36a9d3ec-9397-4e7b-8e94-0eff3088e27f","Type":"ContainerDied","Data":"6b855f52c8b433748e887562002365ac79b3c64d510974216e75532c6df91e0b"}
Nov 04 01:21:20.812344 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.812289    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d7745c5b5-wcgxs"
Nov 04 01:21:20.812533 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.812314    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d7745c5b5-wcgxs" event={"ID":"36a9d3ec-9397-4e7b-8e94-0eff3088e27f","Type":"ContainerDied","Data":"e56ba055cacb5b59cd8d0c6082a3f68a5634093f4b51814d45abd18310a23335"}
Nov 04 01:21:20.820358 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.820340    5640 scope.go:122] "RemoveContainer" containerID="f62cfc376868e511b6d8d30a33d45b62c1184e4e7190d61370f4e973234253b8"
Nov 04 01:21:20.820603 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:21:20.820584    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f62cfc376868e511b6d8d30a33d45b62c1184e4e7190d61370f4e973234253b8\": container with ID starting with f62cfc376868e511b6d8d30a33d45b62c1184e4e7190d61370f4e973234253b8 not found: ID does not exist" containerID="f62cfc376868e511b6d8d30a33d45b62c1184e4e7190d61370f4e973234253b8"
Nov 04 01:21:20.820679 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.820615    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f62cfc376868e511b6d8d30a33d45b62c1184e4e7190d61370f4e973234253b8"} err="failed to get container status \"f62cfc376868e511b6d8d30a33d45b62c1184e4e7190d61370f4e973234253b8\": rpc error: code = NotFound desc = could not find container \"f62cfc376868e511b6d8d30a33d45b62c1184e4e7190d61370f4e973234253b8\": container with ID starting with f62cfc376868e511b6d8d30a33d45b62c1184e4e7190d61370f4e973234253b8 not found: ID does not exist"
Nov 04 01:21:20.820679 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.820636    5640 scope.go:122] "RemoveContainer" containerID="6b855f52c8b433748e887562002365ac79b3c64d510974216e75532c6df91e0b"
Nov 04 01:21:20.829291 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.829276    5640 scope.go:122] "RemoveContainer" containerID="6b855f52c8b433748e887562002365ac79b3c64d510974216e75532c6df91e0b"
Nov 04 01:21:20.829557 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:21:20.829539    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b855f52c8b433748e887562002365ac79b3c64d510974216e75532c6df91e0b\": container with ID starting with 6b855f52c8b433748e887562002365ac79b3c64d510974216e75532c6df91e0b not found: ID does not exist" containerID="6b855f52c8b433748e887562002365ac79b3c64d510974216e75532c6df91e0b"
Nov 04 01:21:20.829644 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.829561    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b855f52c8b433748e887562002365ac79b3c64d510974216e75532c6df91e0b"} err="failed to get container status \"6b855f52c8b433748e887562002365ac79b3c64d510974216e75532c6df91e0b\": rpc error: code = NotFound desc = could not find container \"6b855f52c8b433748e887562002365ac79b3c64d510974216e75532c6df91e0b\": container with ID starting with 6b855f52c8b433748e887562002365ac79b3c64d510974216e75532c6df91e0b not found: ID does not exist"
Nov 04 01:21:20.978543 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.978475    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-ghspq"]
Nov 04 01:21:20.984163 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:20.984140    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-ghspq"]
Nov 04 01:21:21.098123 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:21.098102    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d7745c5b5-wcgxs"]
Nov 04 01:21:21.103121 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:21.103098    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7d7745c5b5-wcgxs"]
Nov 04 01:21:21.562378 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:21.562354    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="36a9d3ec-9397-4e7b-8e94-0eff3088e27f" path="/var/lib/kubelet/pods/36a9d3ec-9397-4e7b-8e94-0eff3088e27f/volumes"
Nov 04 01:21:21.562644 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:21.562633    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="80564d05-3c8a-4a95-9251-747a1914dcca" path="/var/lib/kubelet/pods/80564d05-3c8a-4a95-9251-747a1914dcca/volumes"
Nov 04 01:21:25.817540 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:21:25.817510    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-59b874c49c-hvkkd"
Nov 04 01:21:41.139764 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:21:41.139726    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:22:11.139904 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:22:11.139812    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:22:41.140267 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:22:41.140236    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:23:06.277155 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:06.277126    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-fjq9d"]
Nov 04 01:23:06.277586 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:06.277424    5640 cpu_manager.go:414] "containerMap: removing container" podUID="36a9d3ec-9397-4e7b-8e94-0eff3088e27f" containerName="authorino"
Nov 04 01:23:06.277586 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:06.277435    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36a9d3ec-9397-4e7b-8e94-0eff3088e27f" containerName="authorino"
Nov 04 01:23:06.277586 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:06.277461    5640 cpu_manager.go:414] "containerMap: removing container" podUID="80564d05-3c8a-4a95-9251-747a1914dcca" containerName="authorino"
Nov 04 01:23:06.277586 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:06.277465    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="80564d05-3c8a-4a95-9251-747a1914dcca" containerName="authorino"
Nov 04 01:23:06.277586 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:06.277515    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="80564d05-3c8a-4a95-9251-747a1914dcca" containerName="authorino"
Nov 04 01:23:06.277586 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:06.277526    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="36a9d3ec-9397-4e7b-8e94-0eff3088e27f" containerName="authorino"
Nov 04 01:23:06.280525 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:06.280508    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d8dddb676-fjq9d"
Nov 04 01:23:06.335189 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:06.335164    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-fjq9d"]
Nov 04 01:23:06.338934 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:06.338911    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4zgh\" (UniqueName: \"kubernetes.io/projected/e9ec5a68-bdc2-433b-80ce-f5e6e20058dd-kube-api-access-r4zgh\") pod \"ai-gateway-controller-5d8dddb676-fjq9d\" (UID: \"e9ec5a68-bdc2-433b-80ce-f5e6e20058dd\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-fjq9d"
Nov 04 01:23:06.339044 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:06.338960    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9ec5a68-bdc2-433b-80ce-f5e6e20058dd-metrics-certs\") pod \"ai-gateway-controller-5d8dddb676-fjq9d\" (UID: \"e9ec5a68-bdc2-433b-80ce-f5e6e20058dd\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-fjq9d"
Nov 04 01:23:06.385219 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:06.385194    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Nov 04 01:23:06.385308 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:06.385282    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\""
Nov 04 01:23:06.385363 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:06.385308    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Nov 04 01:23:06.385363 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:06.385333    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\""
Nov 04 01:23:06.386213 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:06.386200    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-4ztdm\""
Nov 04 01:23:06.439540 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:06.439512    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4zgh\" (UniqueName: \"kubernetes.io/projected/e9ec5a68-bdc2-433b-80ce-f5e6e20058dd-kube-api-access-r4zgh\") pod \"ai-gateway-controller-5d8dddb676-fjq9d\" (UID: \"e9ec5a68-bdc2-433b-80ce-f5e6e20058dd\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-fjq9d"
Nov 04 01:23:06.439635 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:06.439559    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9ec5a68-bdc2-433b-80ce-f5e6e20058dd-metrics-certs\") pod \"ai-gateway-controller-5d8dddb676-fjq9d\" (UID: \"e9ec5a68-bdc2-433b-80ce-f5e6e20058dd\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-fjq9d"
Nov 04 01:23:06.441764 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:06.441743    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9ec5a68-bdc2-433b-80ce-f5e6e20058dd-metrics-certs\") pod \"ai-gateway-controller-5d8dddb676-fjq9d\" (UID: \"e9ec5a68-bdc2-433b-80ce-f5e6e20058dd\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-fjq9d"
Nov 04 01:23:06.502172 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:06.502156    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4zgh\" (UniqueName: \"kubernetes.io/projected/e9ec5a68-bdc2-433b-80ce-f5e6e20058dd-kube-api-access-r4zgh\") pod \"ai-gateway-controller-5d8dddb676-fjq9d\" (UID: \"e9ec5a68-bdc2-433b-80ce-f5e6e20058dd\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-fjq9d"
Nov 04 01:23:06.592256 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:06.592206    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d8dddb676-fjq9d"
Nov 04 01:23:06.961087 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:06.961021    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-fjq9d"]
Nov 04 01:23:06.965989 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:23:06.965950    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9ec5a68_bdc2_433b_80ce_f5e6e20058dd.slice/crio-d1fc41bd4897528eb55b2f43b633f042c2d9f50849a7df5ce458df882f865130 WatchSource:0}: Error finding container d1fc41bd4897528eb55b2f43b633f042c2d9f50849a7df5ce458df882f865130: Status 404 returned error can't find the container with id d1fc41bd4897528eb55b2f43b633f042c2d9f50849a7df5ce458df882f865130
Nov 04 01:23:06.967554 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:06.967538    5640 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 01:23:07.221755 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:07.221696    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d8dddb676-fjq9d" event={"ID":"e9ec5a68-bdc2-433b-80ce-f5e6e20058dd","Type":"ContainerStarted","Data":"d1fc41bd4897528eb55b2f43b633f042c2d9f50849a7df5ce458df882f865130"}
Nov 04 01:23:10.235290 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:10.235257    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d8dddb676-fjq9d" event={"ID":"e9ec5a68-bdc2-433b-80ce-f5e6e20058dd","Type":"ContainerStarted","Data":"74b2708ef5912b51238ba292a25523de548f3cd94c7f73b665a0ab34e264e40b"}
Nov 04 01:23:10.235672 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:10.235401    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-5d8dddb676-fjq9d"
Nov 04 01:23:10.355276 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:10.355235    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-5d8dddb676-fjq9d" podStartSLOduration=1.790934056 podStartE2EDuration="4.355224727s" totalImagesPullingTime="2.564290671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:23:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:23:10.354695449 +0000 UTC m=+712.907155584" watchObservedRunningTime="2026-11-04 01:23:10.355224727 +0000 UTC m=+712.907684849"
Nov 04 01:23:11.139678 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:23:11.139644    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:23:13.722774 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:13.722742    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-jfjx2"]
Nov 04 01:23:13.726116 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:13.726100    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-jfjx2"
Nov 04 01:23:13.782220 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:13.782189    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-jfjx2"]
Nov 04 01:23:13.793451 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:13.793429    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/456749d2-dacb-48e0-856f-bfe6c9a363c2-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-jfjx2\" (UID: \"456749d2-dacb-48e0-856f-bfe6c9a363c2\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-jfjx2"
Nov 04 01:23:13.793559 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:13.793486    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqfmc\" (UniqueName: \"kubernetes.io/projected/456749d2-dacb-48e0-856f-bfe6c9a363c2-kube-api-access-mqfmc\") pod \"payload-pre-processing-7b98bb678c-jfjx2\" (UID: \"456749d2-dacb-48e0-856f-bfe6c9a363c2\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-jfjx2"
Nov 04 01:23:13.832490 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:13.832467    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-tcqtx\""
Nov 04 01:23:13.832579 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:13.832546    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Nov 04 01:23:13.880347 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:13.880322    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7bb9489676-6prq8"]
Nov 04 01:23:13.883501 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:13.883486    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bb9489676-6prq8"
Nov 04 01:23:13.894463 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:13.894441    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqfmc\" (UniqueName: \"kubernetes.io/projected/456749d2-dacb-48e0-856f-bfe6c9a363c2-kube-api-access-mqfmc\") pod \"payload-pre-processing-7b98bb678c-jfjx2\" (UID: \"456749d2-dacb-48e0-856f-bfe6c9a363c2\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-jfjx2"
Nov 04 01:23:13.894550 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:13.894494    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/456749d2-dacb-48e0-856f-bfe6c9a363c2-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-jfjx2\" (UID: \"456749d2-dacb-48e0-856f-bfe6c9a363c2\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-jfjx2"
Nov 04 01:23:13.895202 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:13.895187    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/456749d2-dacb-48e0-856f-bfe6c9a363c2-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-jfjx2\" (UID: \"456749d2-dacb-48e0-856f-bfe6c9a363c2\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-jfjx2"
Nov 04 01:23:13.937760 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:13.937734    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bb9489676-6prq8"]
Nov 04 01:23:13.957220 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:13.957199    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqfmc\" (UniqueName: \"kubernetes.io/projected/456749d2-dacb-48e0-856f-bfe6c9a363c2-kube-api-access-mqfmc\") pod \"payload-pre-processing-7b98bb678c-jfjx2\" (UID: \"456749d2-dacb-48e0-856f-bfe6c9a363c2\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-jfjx2"
Nov 04 01:23:13.995679 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:13.995622    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f4dde02-4142-4c05-9151-f0336873dde9-plugins-config-volume\") pod \"payload-processing-7bb9489676-6prq8\" (UID: \"3f4dde02-4142-4c05-9151-f0336873dde9\") " pod="openshift-ingress/payload-processing-7bb9489676-6prq8"
Nov 04 01:23:13.995767 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:13.995727    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhbdc\" (UniqueName: \"kubernetes.io/projected/3f4dde02-4142-4c05-9151-f0336873dde9-kube-api-access-hhbdc\") pod \"payload-processing-7bb9489676-6prq8\" (UID: \"3f4dde02-4142-4c05-9151-f0336873dde9\") " pod="openshift-ingress/payload-processing-7bb9489676-6prq8"
Nov 04 01:23:14.038080 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:14.038058    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-jfjx2"
Nov 04 01:23:14.096661 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:14.096625    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f4dde02-4142-4c05-9151-f0336873dde9-plugins-config-volume\") pod \"payload-processing-7bb9489676-6prq8\" (UID: \"3f4dde02-4142-4c05-9151-f0336873dde9\") " pod="openshift-ingress/payload-processing-7bb9489676-6prq8"
Nov 04 01:23:14.096802 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:14.096753    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhbdc\" (UniqueName: \"kubernetes.io/projected/3f4dde02-4142-4c05-9151-f0336873dde9-kube-api-access-hhbdc\") pod \"payload-processing-7bb9489676-6prq8\" (UID: \"3f4dde02-4142-4c05-9151-f0336873dde9\") " pod="openshift-ingress/payload-processing-7bb9489676-6prq8"
Nov 04 01:23:14.097590 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:14.097559    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f4dde02-4142-4c05-9151-f0336873dde9-plugins-config-volume\") pod \"payload-processing-7bb9489676-6prq8\" (UID: \"3f4dde02-4142-4c05-9151-f0336873dde9\") " pod="openshift-ingress/payload-processing-7bb9489676-6prq8"
Nov 04 01:23:14.178801 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:14.178777    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhbdc\" (UniqueName: \"kubernetes.io/projected/3f4dde02-4142-4c05-9151-f0336873dde9-kube-api-access-hhbdc\") pod \"payload-processing-7bb9489676-6prq8\" (UID: \"3f4dde02-4142-4c05-9151-f0336873dde9\") " pod="openshift-ingress/payload-processing-7bb9489676-6prq8"
Nov 04 01:23:14.196600 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:14.196579    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bb9489676-6prq8"
Nov 04 01:23:14.408089 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:14.408065    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-jfjx2"]
Nov 04 01:23:14.409824 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:23:14.409803    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod456749d2_dacb_48e0_856f_bfe6c9a363c2.slice/crio-7d6879362cd882526e626b976a35108f636e3a1caa2a1010fcc95c334d88f28e WatchSource:0}: Error finding container 7d6879362cd882526e626b976a35108f636e3a1caa2a1010fcc95c334d88f28e: Status 404 returned error can't find the container with id 7d6879362cd882526e626b976a35108f636e3a1caa2a1010fcc95c334d88f28e
Nov 04 01:23:14.570084 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:14.570061    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bb9489676-6prq8"]
Nov 04 01:23:14.571769 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:23:14.571737    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f4dde02_4142_4c05_9151_f0336873dde9.slice/crio-b7bc4f59f54089d33433b086c67fb224db6ca6f69e3ac4b7d42adf2716e87259 WatchSource:0}: Error finding container b7bc4f59f54089d33433b086c67fb224db6ca6f69e3ac4b7d42adf2716e87259: Status 404 returned error can't find the container with id b7bc4f59f54089d33433b086c67fb224db6ca6f69e3ac4b7d42adf2716e87259
Nov 04 01:23:15.262977 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:15.262945    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-jfjx2" event={"ID":"456749d2-dacb-48e0-856f-bfe6c9a363c2","Type":"ContainerStarted","Data":"7d6879362cd882526e626b976a35108f636e3a1caa2a1010fcc95c334d88f28e"}
Nov 04 01:23:15.264080 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:15.264059    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bb9489676-6prq8" event={"ID":"3f4dde02-4142-4c05-9151-f0336873dde9","Type":"ContainerStarted","Data":"b7bc4f59f54089d33433b086c67fb224db6ca6f69e3ac4b7d42adf2716e87259"}
Nov 04 01:23:18.278380 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:18.278346    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bb9489676-6prq8" event={"ID":"3f4dde02-4142-4c05-9151-f0336873dde9","Type":"ContainerStarted","Data":"075535c3e1c7d05535489486398610ef6ffe93f06ff00c744e2c08ff74ea93e8"}
Nov 04 01:23:18.278844 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:18.278407    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bb9489676-6prq8"
Nov 04 01:23:18.279933 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:18.279912    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-jfjx2" event={"ID":"456749d2-dacb-48e0-856f-bfe6c9a363c2","Type":"ContainerStarted","Data":"7955df8b40d69cdc87d793e72f1586d2d88cb4409f4a447ca065aca9f89428c3"}
Nov 04 01:23:18.280024 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:18.279953    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-jfjx2"
Nov 04 01:23:18.397940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:18.397894    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7bb9489676-6prq8" podStartSLOduration=2.404537458 podStartE2EDuration="5.397882148s" totalImagesPullingTime="2.99334469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:23:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:23:18.396808462 +0000 UTC m=+720.949268606" watchObservedRunningTime="2026-11-04 01:23:18.397882148 +0000 UTC m=+720.950342273"
Nov 04 01:23:18.515739 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:18.515696    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7b98bb678c-jfjx2" podStartSLOduration=2.445509818 podStartE2EDuration="5.515684775s" totalImagesPullingTime="3.070174957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:23:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:23:18.515008598 +0000 UTC m=+721.067468744" watchObservedRunningTime="2026-11-04 01:23:18.515684775 +0000 UTC m=+721.068144917"
Nov 04 01:23:21.241456 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:21.241424    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-5d8dddb676-fjq9d"
Nov 04 01:23:21.608786 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:21.608760    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-74b5554cc8-xwm2f"]
Nov 04 01:23:21.612113 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:21.612097    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-74b5554cc8-xwm2f"
Nov 04 01:23:21.665609 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:21.665529    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-74b5554cc8-xwm2f"]
Nov 04 01:23:21.757548 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:21.757517    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d231e576-1204-4dae-919d-bb176a2b9a01-metrics-certs\") pod \"ai-gateway-controller-74b5554cc8-xwm2f\" (UID: \"d231e576-1204-4dae-919d-bb176a2b9a01\") " pod="opendatahub/ai-gateway-controller-74b5554cc8-xwm2f"
Nov 04 01:23:21.757660 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:21.757553    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf6r2\" (UniqueName: \"kubernetes.io/projected/d231e576-1204-4dae-919d-bb176a2b9a01-kube-api-access-bf6r2\") pod \"ai-gateway-controller-74b5554cc8-xwm2f\" (UID: \"d231e576-1204-4dae-919d-bb176a2b9a01\") " pod="opendatahub/ai-gateway-controller-74b5554cc8-xwm2f"
Nov 04 01:23:21.858268 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:21.858232    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d231e576-1204-4dae-919d-bb176a2b9a01-metrics-certs\") pod \"ai-gateway-controller-74b5554cc8-xwm2f\" (UID: \"d231e576-1204-4dae-919d-bb176a2b9a01\") " pod="opendatahub/ai-gateway-controller-74b5554cc8-xwm2f"
Nov 04 01:23:21.858392 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:21.858274    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf6r2\" (UniqueName: \"kubernetes.io/projected/d231e576-1204-4dae-919d-bb176a2b9a01-kube-api-access-bf6r2\") pod \"ai-gateway-controller-74b5554cc8-xwm2f\" (UID: \"d231e576-1204-4dae-919d-bb176a2b9a01\") " pod="opendatahub/ai-gateway-controller-74b5554cc8-xwm2f"
Nov 04 01:23:21.860477 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:21.860432    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d231e576-1204-4dae-919d-bb176a2b9a01-metrics-certs\") pod \"ai-gateway-controller-74b5554cc8-xwm2f\" (UID: \"d231e576-1204-4dae-919d-bb176a2b9a01\") " pod="opendatahub/ai-gateway-controller-74b5554cc8-xwm2f"
Nov 04 01:23:21.920781 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:21.920760    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf6r2\" (UniqueName: \"kubernetes.io/projected/d231e576-1204-4dae-919d-bb176a2b9a01-kube-api-access-bf6r2\") pod \"ai-gateway-controller-74b5554cc8-xwm2f\" (UID: \"d231e576-1204-4dae-919d-bb176a2b9a01\") " pod="opendatahub/ai-gateway-controller-74b5554cc8-xwm2f"
Nov 04 01:23:21.923613 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:21.923594    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-74b5554cc8-xwm2f"
Nov 04 01:23:22.294804 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:22.294313    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-74b5554cc8-xwm2f"]
Nov 04 01:23:22.296424 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:23:22.296391    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd231e576_1204_4dae_919d_bb176a2b9a01.slice/crio-cecb3a5d073a3d7cedad6790eb30d9220451001aa7be47ff74f487ab12ddbccb WatchSource:0}: Error finding container cecb3a5d073a3d7cedad6790eb30d9220451001aa7be47ff74f487ab12ddbccb: Status 404 returned error can't find the container with id cecb3a5d073a3d7cedad6790eb30d9220451001aa7be47ff74f487ab12ddbccb
Nov 04 01:23:23.302498 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:23.302466    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-74b5554cc8-xwm2f" event={"ID":"d231e576-1204-4dae-919d-bb176a2b9a01","Type":"ContainerStarted","Data":"826f6a1b944901c20b31350fdeb377d8efdc4b967bd2b7eebbec93d705da7a47"}
Nov 04 01:23:23.302824 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:23.302524    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-74b5554cc8-xwm2f" event={"ID":"d231e576-1204-4dae-919d-bb176a2b9a01","Type":"ContainerStarted","Data":"cecb3a5d073a3d7cedad6790eb30d9220451001aa7be47ff74f487ab12ddbccb"}
Nov 04 01:23:23.302824 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:23.302575    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-74b5554cc8-xwm2f"
Nov 04 01:23:23.422166 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:23.422121    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-74b5554cc8-xwm2f" podStartSLOduration=1.5103911829999999 podStartE2EDuration="2.422106201s" totalImagesPullingTime="911.715018ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:23:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:23:23.421206155 +0000 UTC m=+725.973666299" watchObservedRunningTime="2026-11-04 01:23:23.422106201 +0000 UTC m=+725.974566327"
Nov 04 01:23:29.286891 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:29.286814    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bb9489676-6prq8"
Nov 04 01:23:29.286891 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:29.286887    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-jfjx2"
Nov 04 01:23:34.307786 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:34.307759    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-74b5554cc8-xwm2f"
Nov 04 01:23:34.479955 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:34.479925    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-fjq9d"]
Nov 04 01:23:34.480156 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:34.480117    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-5d8dddb676-fjq9d" podUID="e9ec5a68-bdc2-433b-80ce-f5e6e20058dd" containerName="manager" containerID="cri-o://74b2708ef5912b51238ba292a25523de548f3cd94c7f73b665a0ab34e264e40b" gracePeriod=30
Nov 04 01:23:34.719581 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:34.719558    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d8dddb676-fjq9d"
Nov 04 01:23:34.849873 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:34.849805    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e9ec5a68-bdc2-433b-80ce-f5e6e20058dd-kube-api-access-r4zgh\" (UniqueName: \"kubernetes.io/projected/e9ec5a68-bdc2-433b-80ce-f5e6e20058dd-kube-api-access-r4zgh\") pod \"e9ec5a68-bdc2-433b-80ce-f5e6e20058dd\" (UID: \"e9ec5a68-bdc2-433b-80ce-f5e6e20058dd\") "
Nov 04 01:23:34.849873 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:34.849854    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e9ec5a68-bdc2-433b-80ce-f5e6e20058dd-metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9ec5a68-bdc2-433b-80ce-f5e6e20058dd-metrics-certs\") pod \"e9ec5a68-bdc2-433b-80ce-f5e6e20058dd\" (UID: \"e9ec5a68-bdc2-433b-80ce-f5e6e20058dd\") "
Nov 04 01:23:34.852050 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:34.852022    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9ec5a68-bdc2-433b-80ce-f5e6e20058dd-kube-api-access-r4zgh" pod "e9ec5a68-bdc2-433b-80ce-f5e6e20058dd" (UID: "e9ec5a68-bdc2-433b-80ce-f5e6e20058dd"). InnerVolumeSpecName "kube-api-access-r4zgh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:23:34.852149 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:34.852024    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9ec5a68-bdc2-433b-80ce-f5e6e20058dd-metrics-certs" pod "e9ec5a68-bdc2-433b-80ce-f5e6e20058dd" (UID: "e9ec5a68-bdc2-433b-80ce-f5e6e20058dd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:23:34.950594 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:34.950569    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4zgh\" (UniqueName: \"kubernetes.io/projected/e9ec5a68-bdc2-433b-80ce-f5e6e20058dd-kube-api-access-r4zgh\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:23:34.950594 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:34.950591    5640 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9ec5a68-bdc2-433b-80ce-f5e6e20058dd-metrics-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:23:35.356667 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:35.356637    5640 generic.go:356] "Generic (PLEG): container finished" podID="e9ec5a68-bdc2-433b-80ce-f5e6e20058dd" containerID="74b2708ef5912b51238ba292a25523de548f3cd94c7f73b665a0ab34e264e40b" exitCode=0
Nov 04 01:23:35.357030 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:35.356684    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d8dddb676-fjq9d"
Nov 04 01:23:35.357030 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:35.356701    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d8dddb676-fjq9d" event={"ID":"e9ec5a68-bdc2-433b-80ce-f5e6e20058dd","Type":"ContainerDied","Data":"74b2708ef5912b51238ba292a25523de548f3cd94c7f73b665a0ab34e264e40b"}
Nov 04 01:23:35.357030 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:35.356741    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d8dddb676-fjq9d" event={"ID":"e9ec5a68-bdc2-433b-80ce-f5e6e20058dd","Type":"ContainerDied","Data":"d1fc41bd4897528eb55b2f43b633f042c2d9f50849a7df5ce458df882f865130"}
Nov 04 01:23:35.357030 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:35.356762    5640 scope.go:122] "RemoveContainer" containerID="74b2708ef5912b51238ba292a25523de548f3cd94c7f73b665a0ab34e264e40b"
Nov 04 01:23:35.365563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:35.365545    5640 scope.go:122] "RemoveContainer" containerID="74b2708ef5912b51238ba292a25523de548f3cd94c7f73b665a0ab34e264e40b"
Nov 04 01:23:35.365808 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:23:35.365793    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74b2708ef5912b51238ba292a25523de548f3cd94c7f73b665a0ab34e264e40b\": container with ID starting with 74b2708ef5912b51238ba292a25523de548f3cd94c7f73b665a0ab34e264e40b not found: ID does not exist" containerID="74b2708ef5912b51238ba292a25523de548f3cd94c7f73b665a0ab34e264e40b"
Nov 04 01:23:35.365845 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:35.365816    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74b2708ef5912b51238ba292a25523de548f3cd94c7f73b665a0ab34e264e40b"} err="failed to get container status \"74b2708ef5912b51238ba292a25523de548f3cd94c7f73b665a0ab34e264e40b\": rpc error: code = NotFound desc = could not find container \"74b2708ef5912b51238ba292a25523de548f3cd94c7f73b665a0ab34e264e40b\": container with ID starting with 74b2708ef5912b51238ba292a25523de548f3cd94c7f73b665a0ab34e264e40b not found: ID does not exist"
Nov 04 01:23:35.524860 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:35.524832    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-fjq9d"]
Nov 04 01:23:35.576192 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:35.576173    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-fjq9d"]
Nov 04 01:23:37.562207 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:37.562172    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e9ec5a68-bdc2-433b-80ce-f5e6e20058dd" path="/var/lib/kubelet/pods/e9ec5a68-bdc2-433b-80ce-f5e6e20058dd/volumes"
Nov 04 01:23:41.139903 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:23:41.139868    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:23:54.903943 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:54.903913    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"]
Nov 04 01:23:54.904363 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:54.904232    5640 cpu_manager.go:414] "containerMap: removing container" podUID="e9ec5a68-bdc2-433b-80ce-f5e6e20058dd" containerName="manager"
Nov 04 01:23:54.904363 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:54.904242    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e9ec5a68-bdc2-433b-80ce-f5e6e20058dd" containerName="manager"
Nov 04 01:23:54.904363 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:54.904300    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="e9ec5a68-bdc2-433b-80ce-f5e6e20058dd" containerName="manager"
Nov 04 01:23:54.912115 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:54.912097    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"
Nov 04 01:23:54.966816 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:54.966779    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Nov 04 01:23:54.999936 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:54.999906    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60967951-4b72-42e1-ab0f-1165bb4a0cfa-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf\" (UID: \"60967951-4b72-42e1-ab0f-1165bb4a0cfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"
Nov 04 01:23:55.000069 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:54.999962    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60967951-4b72-42e1-ab0f-1165bb4a0cfa-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf\" (UID: \"60967951-4b72-42e1-ab0f-1165bb4a0cfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"
Nov 04 01:23:55.000112 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:55.000065    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60967951-4b72-42e1-ab0f-1165bb4a0cfa-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf\" (UID: \"60967951-4b72-42e1-ab0f-1165bb4a0cfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"
Nov 04 01:23:55.000145 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:55.000130    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60967951-4b72-42e1-ab0f-1165bb4a0cfa-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf\" (UID: \"60967951-4b72-42e1-ab0f-1165bb4a0cfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"
Nov 04 01:23:55.000178 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:55.000162    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60967951-4b72-42e1-ab0f-1165bb4a0cfa-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf\" (UID: \"60967951-4b72-42e1-ab0f-1165bb4a0cfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"
Nov 04 01:23:55.000213 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:55.000199    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnxls\" (UniqueName: \"kubernetes.io/projected/60967951-4b72-42e1-ab0f-1165bb4a0cfa-kube-api-access-fnxls\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf\" (UID: \"60967951-4b72-42e1-ab0f-1165bb4a0cfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"
Nov 04 01:23:55.017830 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:55.017814    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Nov 04 01:23:55.017928 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:55.017836    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kccc6\""
Nov 04 01:23:55.017928 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:55.017893    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Nov 04 01:23:55.019002 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:55.018984    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"]
Nov 04 01:23:55.100733 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:55.100714    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnxls\" (UniqueName: \"kubernetes.io/projected/60967951-4b72-42e1-ab0f-1165bb4a0cfa-kube-api-access-fnxls\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf\" (UID: \"60967951-4b72-42e1-ab0f-1165bb4a0cfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"
Nov 04 01:23:55.100833 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:55.100744    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60967951-4b72-42e1-ab0f-1165bb4a0cfa-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf\" (UID: \"60967951-4b72-42e1-ab0f-1165bb4a0cfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"
Nov 04 01:23:55.100833 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:55.100775    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60967951-4b72-42e1-ab0f-1165bb4a0cfa-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf\" (UID: \"60967951-4b72-42e1-ab0f-1165bb4a0cfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"
Nov 04 01:23:55.100833 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:55.100803    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60967951-4b72-42e1-ab0f-1165bb4a0cfa-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf\" (UID: \"60967951-4b72-42e1-ab0f-1165bb4a0cfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"
Nov 04 01:23:55.100833 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:55.100827    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60967951-4b72-42e1-ab0f-1165bb4a0cfa-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf\" (UID: \"60967951-4b72-42e1-ab0f-1165bb4a0cfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"
Nov 04 01:23:55.101021 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:55.100852    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60967951-4b72-42e1-ab0f-1165bb4a0cfa-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf\" (UID: \"60967951-4b72-42e1-ab0f-1165bb4a0cfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"
Nov 04 01:23:55.101224 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:55.101204    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60967951-4b72-42e1-ab0f-1165bb4a0cfa-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf\" (UID: \"60967951-4b72-42e1-ab0f-1165bb4a0cfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"
Nov 04 01:23:55.101315 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:55.101222    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60967951-4b72-42e1-ab0f-1165bb4a0cfa-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf\" (UID: \"60967951-4b72-42e1-ab0f-1165bb4a0cfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"
Nov 04 01:23:55.101315 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:55.101271    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60967951-4b72-42e1-ab0f-1165bb4a0cfa-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf\" (UID: \"60967951-4b72-42e1-ab0f-1165bb4a0cfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"
Nov 04 01:23:55.102999 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:55.102980    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60967951-4b72-42e1-ab0f-1165bb4a0cfa-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf\" (UID: \"60967951-4b72-42e1-ab0f-1165bb4a0cfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"
Nov 04 01:23:55.103153 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:55.103137    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60967951-4b72-42e1-ab0f-1165bb4a0cfa-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf\" (UID: \"60967951-4b72-42e1-ab0f-1165bb4a0cfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"
Nov 04 01:23:55.163433 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:55.163384    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnxls\" (UniqueName: \"kubernetes.io/projected/60967951-4b72-42e1-ab0f-1165bb4a0cfa-kube-api-access-fnxls\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf\" (UID: \"60967951-4b72-42e1-ab0f-1165bb4a0cfa\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"
Nov 04 01:23:55.223532 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:55.223508    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"
Nov 04 01:23:55.600362 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:55.600336    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"]
Nov 04 01:23:55.601768 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:23:55.601748    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60967951_4b72_42e1_ab0f_1165bb4a0cfa.slice/crio-4aebc7898e9419e60ebc52049e70590b8791dc2218f5fcb61e64bd45e275ce47 WatchSource:0}: Error finding container 4aebc7898e9419e60ebc52049e70590b8791dc2218f5fcb61e64bd45e275ce47: Status 404 returned error can't find the container with id 4aebc7898e9419e60ebc52049e70590b8791dc2218f5fcb61e64bd45e275ce47
Nov 04 01:23:56.447252 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:56.447223    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf" event={"ID":"60967951-4b72-42e1-ab0f-1165bb4a0cfa","Type":"ContainerStarted","Data":"4aebc7898e9419e60ebc52049e70590b8791dc2218f5fcb61e64bd45e275ce47"}
Nov 04 01:23:58.457528 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:58.457494    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf" event={"ID":"60967951-4b72-42e1-ab0f-1165bb4a0cfa","Type":"ContainerStarted","Data":"e3bb3b3318f228da153c8c6a261beceb77e56d953084cc3cbcefb9b6c2ce0575"}
Nov 04 01:23:58.579213 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:58.579169    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf" podStartSLOduration=1.8347529790000001 podStartE2EDuration="4.579155581s" totalImagesPullingTime="2.744402602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:23:58.577995595 +0000 UTC m=+761.130455740" watchObservedRunningTime="2026-11-04 01:23:58.579155581 +0000 UTC m=+761.131615710"
Nov 04 01:23:59.223948 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:23:59.223920    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"
Nov 04 01:24:03.817148 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:03.817115    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"]
Nov 04 01:24:03.820163 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:03.820148    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"
Nov 04 01:24:03.869184 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:03.869159    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86003fc7-d47e-4c73-bf1d-3758e6e028f9-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gqxkr\" (UID: \"86003fc7-d47e-4c73-bf1d-3758e6e028f9\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"
Nov 04 01:24:03.869336 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:03.869196    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86003fc7-d47e-4c73-bf1d-3758e6e028f9-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gqxkr\" (UID: \"86003fc7-d47e-4c73-bf1d-3758e6e028f9\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"
Nov 04 01:24:03.869336 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:03.869216    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwxxp\" (UniqueName: \"kubernetes.io/projected/86003fc7-d47e-4c73-bf1d-3758e6e028f9-kube-api-access-gwxxp\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gqxkr\" (UID: \"86003fc7-d47e-4c73-bf1d-3758e6e028f9\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"
Nov 04 01:24:03.869336 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:03.869251    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86003fc7-d47e-4c73-bf1d-3758e6e028f9-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gqxkr\" (UID: \"86003fc7-d47e-4c73-bf1d-3758e6e028f9\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"
Nov 04 01:24:03.869336 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:03.869298    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86003fc7-d47e-4c73-bf1d-3758e6e028f9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gqxkr\" (UID: \"86003fc7-d47e-4c73-bf1d-3758e6e028f9\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"
Nov 04 01:24:03.869617 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:03.869370    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86003fc7-d47e-4c73-bf1d-3758e6e028f9-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gqxkr\" (UID: \"86003fc7-d47e-4c73-bf1d-3758e6e028f9\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"
Nov 04 01:24:03.876636 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:03.876613    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"]
Nov 04 01:24:03.926880 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:03.926858    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Nov 04 01:24:03.970415 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:03.970388    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86003fc7-d47e-4c73-bf1d-3758e6e028f9-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gqxkr\" (UID: \"86003fc7-d47e-4c73-bf1d-3758e6e028f9\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"
Nov 04 01:24:03.970493 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:03.970418    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86003fc7-d47e-4c73-bf1d-3758e6e028f9-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gqxkr\" (UID: \"86003fc7-d47e-4c73-bf1d-3758e6e028f9\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"
Nov 04 01:24:03.970493 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:03.970434    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwxxp\" (UniqueName: \"kubernetes.io/projected/86003fc7-d47e-4c73-bf1d-3758e6e028f9-kube-api-access-gwxxp\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gqxkr\" (UID: \"86003fc7-d47e-4c73-bf1d-3758e6e028f9\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"
Nov 04 01:24:03.970493 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:03.970478    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86003fc7-d47e-4c73-bf1d-3758e6e028f9-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gqxkr\" (UID: \"86003fc7-d47e-4c73-bf1d-3758e6e028f9\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"
Nov 04 01:24:03.970612 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:03.970503    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86003fc7-d47e-4c73-bf1d-3758e6e028f9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gqxkr\" (UID: \"86003fc7-d47e-4c73-bf1d-3758e6e028f9\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"
Nov 04 01:24:03.970612 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:03.970530    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86003fc7-d47e-4c73-bf1d-3758e6e028f9-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gqxkr\" (UID: \"86003fc7-d47e-4c73-bf1d-3758e6e028f9\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"
Nov 04 01:24:03.970882 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:03.970859    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86003fc7-d47e-4c73-bf1d-3758e6e028f9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gqxkr\" (UID: \"86003fc7-d47e-4c73-bf1d-3758e6e028f9\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"
Nov 04 01:24:03.970955 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:03.970895    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86003fc7-d47e-4c73-bf1d-3758e6e028f9-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gqxkr\" (UID: \"86003fc7-d47e-4c73-bf1d-3758e6e028f9\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"
Nov 04 01:24:03.971081 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:03.971010    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86003fc7-d47e-4c73-bf1d-3758e6e028f9-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gqxkr\" (UID: \"86003fc7-d47e-4c73-bf1d-3758e6e028f9\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"
Nov 04 01:24:03.972547 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:03.972529    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86003fc7-d47e-4c73-bf1d-3758e6e028f9-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gqxkr\" (UID: \"86003fc7-d47e-4c73-bf1d-3758e6e028f9\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"
Nov 04 01:24:03.972874 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:03.972858    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86003fc7-d47e-4c73-bf1d-3758e6e028f9-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gqxkr\" (UID: \"86003fc7-d47e-4c73-bf1d-3758e6e028f9\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"
Nov 04 01:24:04.036196 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:04.036168    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwxxp\" (UniqueName: \"kubernetes.io/projected/86003fc7-d47e-4c73-bf1d-3758e6e028f9-kube-api-access-gwxxp\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gqxkr\" (UID: \"86003fc7-d47e-4c73-bf1d-3758e6e028f9\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"
Nov 04 01:24:04.132109 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:04.132059    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"
Nov 04 01:24:04.503998 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:04.503962    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"]
Nov 04 01:24:04.505849 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:24:04.505825    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86003fc7_d47e_4c73_bf1d_3758e6e028f9.slice/crio-8c9664b9db3f0bfbc91d1bfb062279094f952502ab83e2e455a05ece62de788b WatchSource:0}: Error finding container 8c9664b9db3f0bfbc91d1bfb062279094f952502ab83e2e455a05ece62de788b: Status 404 returned error can't find the container with id 8c9664b9db3f0bfbc91d1bfb062279094f952502ab83e2e455a05ece62de788b
Nov 04 01:24:05.224116 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:05.224092    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"
Nov 04 01:24:05.235716 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:05.235698    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"
Nov 04 01:24:05.486921 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:05.486858    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr" event={"ID":"86003fc7-d47e-4c73-bf1d-3758e6e028f9","Type":"ContainerStarted","Data":"23018c9f2d00573efd5de51389921b0af4280947fcf5d6dbe4bd8cb6dba97b45"}
Nov 04 01:24:05.486921 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:05.486901    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr" event={"ID":"86003fc7-d47e-4c73-bf1d-3758e6e028f9","Type":"ContainerStarted","Data":"8c9664b9db3f0bfbc91d1bfb062279094f952502ab83e2e455a05ece62de788b"}
Nov 04 01:24:05.497633 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:05.497616    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf"
Nov 04 01:24:05.607473 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:05.607435    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr" podStartSLOduration=2.01840369 podStartE2EDuration="2.607424686s" totalImagesPullingTime="589.020996ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:24:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:24:05.607292929 +0000 UTC m=+768.159753056" watchObservedRunningTime="2026-11-04 01:24:05.607424686 +0000 UTC m=+768.159884811"
Nov 04 01:24:06.132901 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:06.132876    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"
Nov 04 01:24:07.463234 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:07.463204    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"]
Nov 04 01:24:07.466673 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:07.466655    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"
Nov 04 01:24:07.507034 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:07.507008    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwgjh\" (UniqueName: \"kubernetes.io/projected/aea686c2-6a33-47f2-bbbe-8e019648649f-kube-api-access-qwgjh\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-n6pxb\" (UID: \"aea686c2-6a33-47f2-bbbe-8e019648649f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"
Nov 04 01:24:07.507133 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:07.507046    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aea686c2-6a33-47f2-bbbe-8e019648649f-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-n6pxb\" (UID: \"aea686c2-6a33-47f2-bbbe-8e019648649f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"
Nov 04 01:24:07.507191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:07.507166    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aea686c2-6a33-47f2-bbbe-8e019648649f-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-n6pxb\" (UID: \"aea686c2-6a33-47f2-bbbe-8e019648649f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"
Nov 04 01:24:07.507230 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:07.507214    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aea686c2-6a33-47f2-bbbe-8e019648649f-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-n6pxb\" (UID: \"aea686c2-6a33-47f2-bbbe-8e019648649f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"
Nov 04 01:24:07.507298 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:07.507280    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aea686c2-6a33-47f2-bbbe-8e019648649f-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-n6pxb\" (UID: \"aea686c2-6a33-47f2-bbbe-8e019648649f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"
Nov 04 01:24:07.507379 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:07.507365    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aea686c2-6a33-47f2-bbbe-8e019648649f-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-n6pxb\" (UID: \"aea686c2-6a33-47f2-bbbe-8e019648649f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"
Nov 04 01:24:07.522062 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:07.522037    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"]
Nov 04 01:24:07.572505 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:07.572486    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Nov 04 01:24:07.608439 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:07.608407    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwgjh\" (UniqueName: \"kubernetes.io/projected/aea686c2-6a33-47f2-bbbe-8e019648649f-kube-api-access-qwgjh\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-n6pxb\" (UID: \"aea686c2-6a33-47f2-bbbe-8e019648649f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"
Nov 04 01:24:07.608552 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:07.608446    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aea686c2-6a33-47f2-bbbe-8e019648649f-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-n6pxb\" (UID: \"aea686c2-6a33-47f2-bbbe-8e019648649f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"
Nov 04 01:24:07.608552 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:07.608494    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aea686c2-6a33-47f2-bbbe-8e019648649f-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-n6pxb\" (UID: \"aea686c2-6a33-47f2-bbbe-8e019648649f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"
Nov 04 01:24:07.608552 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:07.608520    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aea686c2-6a33-47f2-bbbe-8e019648649f-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-n6pxb\" (UID: \"aea686c2-6a33-47f2-bbbe-8e019648649f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"
Nov 04 01:24:07.608711 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:07.608549    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aea686c2-6a33-47f2-bbbe-8e019648649f-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-n6pxb\" (UID: \"aea686c2-6a33-47f2-bbbe-8e019648649f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"
Nov 04 01:24:07.608711 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:07.608629    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aea686c2-6a33-47f2-bbbe-8e019648649f-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-n6pxb\" (UID: \"aea686c2-6a33-47f2-bbbe-8e019648649f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"
Nov 04 01:24:07.609313 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:07.609034    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aea686c2-6a33-47f2-bbbe-8e019648649f-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-n6pxb\" (UID: \"aea686c2-6a33-47f2-bbbe-8e019648649f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"
Nov 04 01:24:07.609313 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:07.609076    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aea686c2-6a33-47f2-bbbe-8e019648649f-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-n6pxb\" (UID: \"aea686c2-6a33-47f2-bbbe-8e019648649f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"
Nov 04 01:24:07.609313 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:07.609306    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aea686c2-6a33-47f2-bbbe-8e019648649f-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-n6pxb\" (UID: \"aea686c2-6a33-47f2-bbbe-8e019648649f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"
Nov 04 01:24:07.610877 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:07.610854    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aea686c2-6a33-47f2-bbbe-8e019648649f-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-n6pxb\" (UID: \"aea686c2-6a33-47f2-bbbe-8e019648649f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"
Nov 04 01:24:07.611262 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:07.611245    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aea686c2-6a33-47f2-bbbe-8e019648649f-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-n6pxb\" (UID: \"aea686c2-6a33-47f2-bbbe-8e019648649f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"
Nov 04 01:24:07.671945 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:07.671923    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwgjh\" (UniqueName: \"kubernetes.io/projected/aea686c2-6a33-47f2-bbbe-8e019648649f-kube-api-access-qwgjh\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-n6pxb\" (UID: \"aea686c2-6a33-47f2-bbbe-8e019648649f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"
Nov 04 01:24:07.778375 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:07.778349    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"
Nov 04 01:24:08.150037 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:08.150013    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"]
Nov 04 01:24:08.151875 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:24:08.151844    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaea686c2_6a33_47f2_bbbe_8e019648649f.slice/crio-71c115180e6a2c17982d6b79edd601e9eefb86101618d12acb020d2b29d42292 WatchSource:0}: Error finding container 71c115180e6a2c17982d6b79edd601e9eefb86101618d12acb020d2b29d42292: Status 404 returned error can't find the container with id 71c115180e6a2c17982d6b79edd601e9eefb86101618d12acb020d2b29d42292
Nov 04 01:24:08.501687 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:08.501626    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb" event={"ID":"aea686c2-6a33-47f2-bbbe-8e019648649f","Type":"ContainerStarted","Data":"71c115180e6a2c17982d6b79edd601e9eefb86101618d12acb020d2b29d42292"}
Nov 04 01:24:09.507775 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:09.507737    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb" event={"ID":"aea686c2-6a33-47f2-bbbe-8e019648649f","Type":"ContainerStarted","Data":"4ebe2f022b66242c27beffd2c72ed3f1192d9ae38609e8833abbf336653c9d81"}
Nov 04 01:24:09.629129 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:09.629090    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb" podStartSLOduration=1.981799323 podStartE2EDuration="2.62907799s" totalImagesPullingTime="647.278667ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:24:09.628243197 +0000 UTC m=+772.180703366" watchObservedRunningTime="2026-11-04 01:24:09.62907799 +0000 UTC m=+772.181538094"
Nov 04 01:24:09.779124 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:09.779099    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"
Nov 04 01:24:10.767084 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:10.767051    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"]
Nov 04 01:24:10.770548 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:10.770528    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"
Nov 04 01:24:10.825817 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:10.825784    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"]
Nov 04 01:24:10.833975 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:10.833951    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4d765cf-971a-4596-b472-c32029e26ea8-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-6f4h4\" (UID: \"f4d765cf-971a-4596-b472-c32029e26ea8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"
Nov 04 01:24:10.834095 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:10.833987    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4d765cf-971a-4596-b472-c32029e26ea8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-6f4h4\" (UID: \"f4d765cf-971a-4596-b472-c32029e26ea8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"
Nov 04 01:24:10.834158 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:10.834113    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4d765cf-971a-4596-b472-c32029e26ea8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-6f4h4\" (UID: \"f4d765cf-971a-4596-b472-c32029e26ea8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"
Nov 04 01:24:10.834210 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:10.834173    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmq2h\" (UniqueName: \"kubernetes.io/projected/f4d765cf-971a-4596-b472-c32029e26ea8-kube-api-access-rmq2h\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-6f4h4\" (UID: \"f4d765cf-971a-4596-b472-c32029e26ea8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"
Nov 04 01:24:10.834248 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:10.834229    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4d765cf-971a-4596-b472-c32029e26ea8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-6f4h4\" (UID: \"f4d765cf-971a-4596-b472-c32029e26ea8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"
Nov 04 01:24:10.834304 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:10.834256    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4d765cf-971a-4596-b472-c32029e26ea8-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-6f4h4\" (UID: \"f4d765cf-971a-4596-b472-c32029e26ea8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"
Nov 04 01:24:10.875978 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:10.875944    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Nov 04 01:24:10.935088 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:10.935062    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4d765cf-971a-4596-b472-c32029e26ea8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-6f4h4\" (UID: \"f4d765cf-971a-4596-b472-c32029e26ea8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"
Nov 04 01:24:10.935193 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:10.935108    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmq2h\" (UniqueName: \"kubernetes.io/projected/f4d765cf-971a-4596-b472-c32029e26ea8-kube-api-access-rmq2h\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-6f4h4\" (UID: \"f4d765cf-971a-4596-b472-c32029e26ea8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"
Nov 04 01:24:10.935193 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:10.935127    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4d765cf-971a-4596-b472-c32029e26ea8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-6f4h4\" (UID: \"f4d765cf-971a-4596-b472-c32029e26ea8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"
Nov 04 01:24:10.935193 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:10.935168    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4d765cf-971a-4596-b472-c32029e26ea8-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-6f4h4\" (UID: \"f4d765cf-971a-4596-b472-c32029e26ea8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"
Nov 04 01:24:10.935342 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:10.935212    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4d765cf-971a-4596-b472-c32029e26ea8-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-6f4h4\" (UID: \"f4d765cf-971a-4596-b472-c32029e26ea8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"
Nov 04 01:24:10.935342 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:10.935234    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4d765cf-971a-4596-b472-c32029e26ea8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-6f4h4\" (UID: \"f4d765cf-971a-4596-b472-c32029e26ea8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"
Nov 04 01:24:10.935540 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:10.935516    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4d765cf-971a-4596-b472-c32029e26ea8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-6f4h4\" (UID: \"f4d765cf-971a-4596-b472-c32029e26ea8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"
Nov 04 01:24:10.935787 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:10.935597    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4d765cf-971a-4596-b472-c32029e26ea8-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-6f4h4\" (UID: \"f4d765cf-971a-4596-b472-c32029e26ea8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"
Nov 04 01:24:10.935787 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:10.935740    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4d765cf-971a-4596-b472-c32029e26ea8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-6f4h4\" (UID: \"f4d765cf-971a-4596-b472-c32029e26ea8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"
Nov 04 01:24:10.937462 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:10.937442    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4d765cf-971a-4596-b472-c32029e26ea8-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-6f4h4\" (UID: \"f4d765cf-971a-4596-b472-c32029e26ea8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"
Nov 04 01:24:10.937738 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:10.937720    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4d765cf-971a-4596-b472-c32029e26ea8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-6f4h4\" (UID: \"f4d765cf-971a-4596-b472-c32029e26ea8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"
Nov 04 01:24:10.997960 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:10.997931    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmq2h\" (UniqueName: \"kubernetes.io/projected/f4d765cf-971a-4596-b472-c32029e26ea8-kube-api-access-rmq2h\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-6f4h4\" (UID: \"f4d765cf-971a-4596-b472-c32029e26ea8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"
Nov 04 01:24:11.082010 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:11.081978    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"
Nov 04 01:24:11.151509 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:24:11.151478    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:24:11.456404 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:11.456379    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"]
Nov 04 01:24:11.457755 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:24:11.457721    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4d765cf_971a_4596_b472_c32029e26ea8.slice/crio-539dc782352aa4dfb8886df9e1c071017c8813325784142fa69724a013598711 WatchSource:0}: Error finding container 539dc782352aa4dfb8886df9e1c071017c8813325784142fa69724a013598711: Status 404 returned error can't find the container with id 539dc782352aa4dfb8886df9e1c071017c8813325784142fa69724a013598711
Nov 04 01:24:11.517359 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:11.517332    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4" event={"ID":"f4d765cf-971a-4596-b472-c32029e26ea8","Type":"ContainerStarted","Data":"539dc782352aa4dfb8886df9e1c071017c8813325784142fa69724a013598711"}
Nov 04 01:24:12.523126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:12.523095    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4" event={"ID":"f4d765cf-971a-4596-b472-c32029e26ea8","Type":"ContainerStarted","Data":"c8f3d17e0fd6960da1313f01f9bb85c8de838bfbcacf0db041fe22b5128b6123"}
Nov 04 01:24:12.644699 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:12.644650    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4" podStartSLOduration=1.983164072 podStartE2EDuration="2.64463842s" totalImagesPullingTime="661.474348ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:24:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:24:12.644214513 +0000 UTC m=+775.196674639" watchObservedRunningTime="2026-11-04 01:24:12.64463842 +0000 UTC m=+775.197098524"
Nov 04 01:24:13.082788 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:13.082766    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"
Nov 04 01:24:14.132961 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.132923    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"
Nov 04 01:24:14.144985 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.144944    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"
Nov 04 01:24:14.202227 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.202191    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"]
Nov 04 01:24:14.205725 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.205703    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"
Nov 04 01:24:14.260781 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.260747    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00152e02-0a5c-4f4e-be7c-6ad51d505557-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm\" (UID: \"00152e02-0a5c-4f4e-be7c-6ad51d505557\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"
Nov 04 01:24:14.260950 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.260817    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00152e02-0a5c-4f4e-be7c-6ad51d505557-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm\" (UID: \"00152e02-0a5c-4f4e-be7c-6ad51d505557\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"
Nov 04 01:24:14.260950 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.260846    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00152e02-0a5c-4f4e-be7c-6ad51d505557-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm\" (UID: \"00152e02-0a5c-4f4e-be7c-6ad51d505557\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"
Nov 04 01:24:14.260950 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.260868    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv4nq\" (UniqueName: \"kubernetes.io/projected/00152e02-0a5c-4f4e-be7c-6ad51d505557-kube-api-access-pv4nq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm\" (UID: \"00152e02-0a5c-4f4e-be7c-6ad51d505557\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"
Nov 04 01:24:14.260950 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.260905    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00152e02-0a5c-4f4e-be7c-6ad51d505557-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm\" (UID: \"00152e02-0a5c-4f4e-be7c-6ad51d505557\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"
Nov 04 01:24:14.260950 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.260911    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"]
Nov 04 01:24:14.261241 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.260995    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00152e02-0a5c-4f4e-be7c-6ad51d505557-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm\" (UID: \"00152e02-0a5c-4f4e-be7c-6ad51d505557\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"
Nov 04 01:24:14.265056 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.265035    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Nov 04 01:24:14.361731 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.361695    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00152e02-0a5c-4f4e-be7c-6ad51d505557-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm\" (UID: \"00152e02-0a5c-4f4e-be7c-6ad51d505557\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"
Nov 04 01:24:14.361922 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.361768    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00152e02-0a5c-4f4e-be7c-6ad51d505557-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm\" (UID: \"00152e02-0a5c-4f4e-be7c-6ad51d505557\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"
Nov 04 01:24:14.361922 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.361831    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00152e02-0a5c-4f4e-be7c-6ad51d505557-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm\" (UID: \"00152e02-0a5c-4f4e-be7c-6ad51d505557\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"
Nov 04 01:24:14.361922 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.361854    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv4nq\" (UniqueName: \"kubernetes.io/projected/00152e02-0a5c-4f4e-be7c-6ad51d505557-kube-api-access-pv4nq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm\" (UID: \"00152e02-0a5c-4f4e-be7c-6ad51d505557\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"
Nov 04 01:24:14.361922 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.361894    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00152e02-0a5c-4f4e-be7c-6ad51d505557-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm\" (UID: \"00152e02-0a5c-4f4e-be7c-6ad51d505557\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"
Nov 04 01:24:14.362163 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.361961    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00152e02-0a5c-4f4e-be7c-6ad51d505557-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm\" (UID: \"00152e02-0a5c-4f4e-be7c-6ad51d505557\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"
Nov 04 01:24:14.362315 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.362290    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00152e02-0a5c-4f4e-be7c-6ad51d505557-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm\" (UID: \"00152e02-0a5c-4f4e-be7c-6ad51d505557\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"
Nov 04 01:24:14.362383 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.362314    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00152e02-0a5c-4f4e-be7c-6ad51d505557-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm\" (UID: \"00152e02-0a5c-4f4e-be7c-6ad51d505557\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"
Nov 04 01:24:14.362383 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.362339    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00152e02-0a5c-4f4e-be7c-6ad51d505557-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm\" (UID: \"00152e02-0a5c-4f4e-be7c-6ad51d505557\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"
Nov 04 01:24:14.364431 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.364401    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00152e02-0a5c-4f4e-be7c-6ad51d505557-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm\" (UID: \"00152e02-0a5c-4f4e-be7c-6ad51d505557\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"
Nov 04 01:24:14.364544 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.364509    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00152e02-0a5c-4f4e-be7c-6ad51d505557-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm\" (UID: \"00152e02-0a5c-4f4e-be7c-6ad51d505557\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"
Nov 04 01:24:14.425666 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.425598    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv4nq\" (UniqueName: \"kubernetes.io/projected/00152e02-0a5c-4f4e-be7c-6ad51d505557-kube-api-access-pv4nq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm\" (UID: \"00152e02-0a5c-4f4e-be7c-6ad51d505557\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"
Nov 04 01:24:14.518339 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.518307    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"
Nov 04 01:24:14.545523 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.545495    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gqxkr"
Nov 04 01:24:14.897422 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:14.897397    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"]
Nov 04 01:24:14.899254 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:24:14.899226    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00152e02_0a5c_4f4e_be7c_6ad51d505557.slice/crio-16d310cbbe6bbaac77510977ce13b7ad09ab659bb91b3eae3a4680bb81bf65e2 WatchSource:0}: Error finding container 16d310cbbe6bbaac77510977ce13b7ad09ab659bb91b3eae3a4680bb81bf65e2: Status 404 returned error can't find the container with id 16d310cbbe6bbaac77510977ce13b7ad09ab659bb91b3eae3a4680bb81bf65e2
Nov 04 01:24:15.539698 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:15.539673    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm" event={"ID":"00152e02-0a5c-4f4e-be7c-6ad51d505557","Type":"ContainerStarted","Data":"16d310cbbe6bbaac77510977ce13b7ad09ab659bb91b3eae3a4680bb81bf65e2"}
Nov 04 01:24:16.545345 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:16.545314    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm" event={"ID":"00152e02-0a5c-4f4e-be7c-6ad51d505557","Type":"ContainerStarted","Data":"ffbc7caa939234f248a9039af8b66f2f3a97b7ba476c4f343611c2c2acef565b"}
Nov 04 01:24:16.666407 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:16.666359    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm" podStartSLOduration=2.07240615 podStartE2EDuration="2.666346647s" totalImagesPullingTime="593.940497ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:24:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:24:16.665827105 +0000 UTC m=+779.218287251" watchObservedRunningTime="2026-11-04 01:24:16.666346647 +0000 UTC m=+779.218806774"
Nov 04 01:24:17.519026 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:17.518999    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"
Nov 04 01:24:17.779003 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:17.778963    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"
Nov 04 01:24:17.791238 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:17.791212    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"
Nov 04 01:24:17.985474 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:17.985447    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-mjdhk"]
Nov 04 01:24:17.990171 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:17.990156    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk"
Nov 04 01:24:18.044469 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:18.044404    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"echo-simulator-kserve-self-signed-certs\""
Nov 04 01:24:18.045051 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:18.045029    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-mjdhk"]
Nov 04 01:24:18.095068 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:18.095042    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab21243d-1380-4344-9ed8-3c5de602e47e-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-mjdhk\" (UID: \"ab21243d-1380-4344-9ed8-3c5de602e47e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk"
Nov 04 01:24:18.095191 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:18.095082    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab21243d-1380-4344-9ed8-3c5de602e47e-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-mjdhk\" (UID: \"ab21243d-1380-4344-9ed8-3c5de602e47e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk"
Nov 04 01:24:18.095232 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:18.095210    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab21243d-1380-4344-9ed8-3c5de602e47e-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-mjdhk\" (UID: \"ab21243d-1380-4344-9ed8-3c5de602e47e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk"
Nov 04 01:24:18.095268 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:18.095251    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdvpt\" (UniqueName: \"kubernetes.io/projected/ab21243d-1380-4344-9ed8-3c5de602e47e-kube-api-access-xdvpt\") pod \"echo-simulator-kserve-64b6f8f96c-mjdhk\" (UID: \"ab21243d-1380-4344-9ed8-3c5de602e47e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk"
Nov 04 01:24:18.095300 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:18.095288    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab21243d-1380-4344-9ed8-3c5de602e47e-home\") pod \"echo-simulator-kserve-64b6f8f96c-mjdhk\" (UID: \"ab21243d-1380-4344-9ed8-3c5de602e47e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk"
Nov 04 01:24:18.095332 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:18.095326    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab21243d-1380-4344-9ed8-3c5de602e47e-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-mjdhk\" (UID: \"ab21243d-1380-4344-9ed8-3c5de602e47e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk"
Nov 04 01:24:18.196015 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:18.195990    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab21243d-1380-4344-9ed8-3c5de602e47e-home\") pod \"echo-simulator-kserve-64b6f8f96c-mjdhk\" (UID: \"ab21243d-1380-4344-9ed8-3c5de602e47e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk"
Nov 04 01:24:18.196169 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:18.196030    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab21243d-1380-4344-9ed8-3c5de602e47e-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-mjdhk\" (UID: \"ab21243d-1380-4344-9ed8-3c5de602e47e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk"
Nov 04 01:24:18.196169 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:18.196064    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab21243d-1380-4344-9ed8-3c5de602e47e-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-mjdhk\" (UID: \"ab21243d-1380-4344-9ed8-3c5de602e47e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk"
Nov 04 01:24:18.196169 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:18.196095    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab21243d-1380-4344-9ed8-3c5de602e47e-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-mjdhk\" (UID: \"ab21243d-1380-4344-9ed8-3c5de602e47e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk"
Nov 04 01:24:18.196169 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:18.196152    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab21243d-1380-4344-9ed8-3c5de602e47e-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-mjdhk\" (UID: \"ab21243d-1380-4344-9ed8-3c5de602e47e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk"
Nov 04 01:24:18.196375 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:18.196197    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdvpt\" (UniqueName: \"kubernetes.io/projected/ab21243d-1380-4344-9ed8-3c5de602e47e-kube-api-access-xdvpt\") pod \"echo-simulator-kserve-64b6f8f96c-mjdhk\" (UID: \"ab21243d-1380-4344-9ed8-3c5de602e47e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk"
Nov 04 01:24:18.196375 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:18.196307    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab21243d-1380-4344-9ed8-3c5de602e47e-home\") pod \"echo-simulator-kserve-64b6f8f96c-mjdhk\" (UID: \"ab21243d-1380-4344-9ed8-3c5de602e47e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk"
Nov 04 01:24:18.196477 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:18.196414    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab21243d-1380-4344-9ed8-3c5de602e47e-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-mjdhk\" (UID: \"ab21243d-1380-4344-9ed8-3c5de602e47e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk"
Nov 04 01:24:18.196477 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:18.196442    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab21243d-1380-4344-9ed8-3c5de602e47e-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-mjdhk\" (UID: \"ab21243d-1380-4344-9ed8-3c5de602e47e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk"
Nov 04 01:24:18.198388 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:18.198368    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab21243d-1380-4344-9ed8-3c5de602e47e-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-mjdhk\" (UID: \"ab21243d-1380-4344-9ed8-3c5de602e47e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk"
Nov 04 01:24:18.198497 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:18.198447    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab21243d-1380-4344-9ed8-3c5de602e47e-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-mjdhk\" (UID: \"ab21243d-1380-4344-9ed8-3c5de602e47e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk"
Nov 04 01:24:18.261081 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:18.261055    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdvpt\" (UniqueName: \"kubernetes.io/projected/ab21243d-1380-4344-9ed8-3c5de602e47e-kube-api-access-xdvpt\") pod \"echo-simulator-kserve-64b6f8f96c-mjdhk\" (UID: \"ab21243d-1380-4344-9ed8-3c5de602e47e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk"
Nov 04 01:24:18.301817 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:18.301768    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk"
Nov 04 01:24:18.569674 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:18.569606    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-n6pxb"
Nov 04 01:24:18.674004 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:18.673983    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-mjdhk"]
Nov 04 01:24:18.675455 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:24:18.675433    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab21243d_1380_4344_9ed8_3c5de602e47e.slice/crio-d1218641100d44ae09c9239a2429ca35f19142c6dfab04a869a44db09bfc13ed WatchSource:0}: Error finding container d1218641100d44ae09c9239a2429ca35f19142c6dfab04a869a44db09bfc13ed: Status 404 returned error can't find the container with id d1218641100d44ae09c9239a2429ca35f19142c6dfab04a869a44db09bfc13ed
Nov 04 01:24:19.565760 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:19.565727    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk" event={"ID":"ab21243d-1380-4344-9ed8-3c5de602e47e","Type":"ContainerStarted","Data":"d1218641100d44ae09c9239a2429ca35f19142c6dfab04a869a44db09bfc13ed"}
Nov 04 01:24:21.082162 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:21.082126    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"
Nov 04 01:24:21.095534 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:21.095513    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"
Nov 04 01:24:21.577430 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:21.577395    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk" event={"ID":"ab21243d-1380-4344-9ed8-3c5de602e47e","Type":"ContainerStarted","Data":"fee34bc60f06aebab1728a89cdf94298b3a84ea38d4a30a845e590c96e63c7fc"}
Nov 04 01:24:21.588427 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:21.588404    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-6f4h4"
Nov 04 01:24:21.698937 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:21.698847    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk" podStartSLOduration=1.9713079690000002 podStartE2EDuration="4.698833012s" totalImagesPullingTime="2.727525043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:24:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:24:21.698267274 +0000 UTC m=+784.250727434" watchObservedRunningTime="2026-11-04 01:24:21.698833012 +0000 UTC m=+784.251293136"
Nov 04 01:24:22.301920 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:22.301879    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk"
Nov 04 01:24:24.518987 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:24.518942    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"
Nov 04 01:24:24.531342 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:24.531319    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"
Nov 04 01:24:24.602199 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:24.602166    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm"
Nov 04 01:24:25.466767 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:25.466733    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"]
Nov 04 01:24:25.471680 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:25.471645    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"
Nov 04 01:24:25.526015 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:25.525982    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"]
Nov 04 01:24:25.526426 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:25.526417    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Nov 04 01:24:25.577025 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:25.576994    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bc33a66-abf0-48fe-9e4f-4caef1dd2855-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv\" (UID: \"4bc33a66-abf0-48fe-9e4f-4caef1dd2855\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"
Nov 04 01:24:25.577160 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:25.577027    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4rzs\" (UniqueName: \"kubernetes.io/projected/4bc33a66-abf0-48fe-9e4f-4caef1dd2855-kube-api-access-v4rzs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv\" (UID: \"4bc33a66-abf0-48fe-9e4f-4caef1dd2855\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"
Nov 04 01:24:25.577160 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:25.577100    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bc33a66-abf0-48fe-9e4f-4caef1dd2855-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv\" (UID: \"4bc33a66-abf0-48fe-9e4f-4caef1dd2855\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"
Nov 04 01:24:25.577237 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:25.577167    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bc33a66-abf0-48fe-9e4f-4caef1dd2855-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv\" (UID: \"4bc33a66-abf0-48fe-9e4f-4caef1dd2855\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"
Nov 04 01:24:25.577237 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:25.577190    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bc33a66-abf0-48fe-9e4f-4caef1dd2855-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv\" (UID: \"4bc33a66-abf0-48fe-9e4f-4caef1dd2855\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"
Nov 04 01:24:25.577312 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:25.577277    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bc33a66-abf0-48fe-9e4f-4caef1dd2855-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv\" (UID: \"4bc33a66-abf0-48fe-9e4f-4caef1dd2855\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"
Nov 04 01:24:25.678187 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:25.678159    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bc33a66-abf0-48fe-9e4f-4caef1dd2855-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv\" (UID: \"4bc33a66-abf0-48fe-9e4f-4caef1dd2855\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"
Nov 04 01:24:25.678349 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:25.678202    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bc33a66-abf0-48fe-9e4f-4caef1dd2855-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv\" (UID: \"4bc33a66-abf0-48fe-9e4f-4caef1dd2855\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"
Nov 04 01:24:25.678349 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:25.678218    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bc33a66-abf0-48fe-9e4f-4caef1dd2855-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv\" (UID: \"4bc33a66-abf0-48fe-9e4f-4caef1dd2855\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"
Nov 04 01:24:25.678496 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:25.678355    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bc33a66-abf0-48fe-9e4f-4caef1dd2855-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv\" (UID: \"4bc33a66-abf0-48fe-9e4f-4caef1dd2855\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"
Nov 04 01:24:25.678496 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:25.678480    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bc33a66-abf0-48fe-9e4f-4caef1dd2855-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv\" (UID: \"4bc33a66-abf0-48fe-9e4f-4caef1dd2855\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"
Nov 04 01:24:25.678579 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:25.678508    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4rzs\" (UniqueName: \"kubernetes.io/projected/4bc33a66-abf0-48fe-9e4f-4caef1dd2855-kube-api-access-v4rzs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv\" (UID: \"4bc33a66-abf0-48fe-9e4f-4caef1dd2855\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"
Nov 04 01:24:25.678633 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:25.678592    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bc33a66-abf0-48fe-9e4f-4caef1dd2855-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv\" (UID: \"4bc33a66-abf0-48fe-9e4f-4caef1dd2855\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"
Nov 04 01:24:25.678787 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:25.678759    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bc33a66-abf0-48fe-9e4f-4caef1dd2855-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv\" (UID: \"4bc33a66-abf0-48fe-9e4f-4caef1dd2855\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"
Nov 04 01:24:25.678922 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:25.678872    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bc33a66-abf0-48fe-9e4f-4caef1dd2855-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv\" (UID: \"4bc33a66-abf0-48fe-9e4f-4caef1dd2855\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"
Nov 04 01:24:25.680555 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:25.680535    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bc33a66-abf0-48fe-9e4f-4caef1dd2855-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv\" (UID: \"4bc33a66-abf0-48fe-9e4f-4caef1dd2855\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"
Nov 04 01:24:25.680658 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:25.680640    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bc33a66-abf0-48fe-9e4f-4caef1dd2855-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv\" (UID: \"4bc33a66-abf0-48fe-9e4f-4caef1dd2855\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"
Nov 04 01:24:25.740794 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:25.740734    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4rzs\" (UniqueName: \"kubernetes.io/projected/4bc33a66-abf0-48fe-9e4f-4caef1dd2855-kube-api-access-v4rzs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv\" (UID: \"4bc33a66-abf0-48fe-9e4f-4caef1dd2855\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"
Nov 04 01:24:25.784189 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:25.784167    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"
Nov 04 01:24:26.158361 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:26.158332    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"]
Nov 04 01:24:26.160313 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:24:26.160286    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4bc33a66_abf0_48fe_9e4f_4caef1dd2855.slice/crio-93273dbfb188a792a81e30db48f9adc1e7b4a2d77e6456089a51ccc58a38c176 WatchSource:0}: Error finding container 93273dbfb188a792a81e30db48f9adc1e7b4a2d77e6456089a51ccc58a38c176: Status 404 returned error can't find the container with id 93273dbfb188a792a81e30db48f9adc1e7b4a2d77e6456089a51ccc58a38c176
Nov 04 01:24:26.601618 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:26.601581    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv" event={"ID":"4bc33a66-abf0-48fe-9e4f-4caef1dd2855","Type":"ContainerStarted","Data":"93273dbfb188a792a81e30db48f9adc1e7b4a2d77e6456089a51ccc58a38c176"}
Nov 04 01:24:27.607323 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:27.607284    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv" event={"ID":"4bc33a66-abf0-48fe-9e4f-4caef1dd2855","Type":"ContainerStarted","Data":"ccef187217c91cabc67719d7b1fcf69889830d057b9ba329edfa3719d8f3087c"}
Nov 04 01:24:27.728113 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:27.728062    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv" podStartSLOduration=2.1615191129999998 podStartE2EDuration="2.728048599s" totalImagesPullingTime="566.529486ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:24:27.72757768 +0000 UTC m=+790.280037805" watchObservedRunningTime="2026-11-04 01:24:27.728048599 +0000 UTC m=+790.280508781"
Nov 04 01:24:27.784647 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:27.784615    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"
Nov 04 01:24:28.302526 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:28.302497    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk"
Nov 04 01:24:28.314460 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:28.314437    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk"
Nov 04 01:24:28.622783 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:28.622708    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/echo-simulator-kserve-64b6f8f96c-mjdhk"
Nov 04 01:24:35.784715 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:35.784685    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"
Nov 04 01:24:35.796569 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:35.796550    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"
Nov 04 01:24:36.657445 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:36.657374    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv"
Nov 04 01:24:41.140424 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:24:41.140390    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:24:53.764469 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.764439    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"]
Nov 04 01:24:53.771185 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.771165    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.802708 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.802678    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.802830 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.802716    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.802830 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.802738    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.802830 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.802802    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/030db177-0bd3-4c71-a4e6-b80e5782150d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.803045 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.802979    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.803045 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.803010    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.803154 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.803067    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnflk\" (UniqueName: \"kubernetes.io/projected/030db177-0bd3-4c71-a4e6-b80e5782150d-kube-api-access-dnflk\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.803154 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.803101    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.803248 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.803164    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.826176 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.826152    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-kcfvk\""
Nov 04 01:24:53.877044 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.877007    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Nov 04 01:24:53.878449 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.878426    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"]
Nov 04 01:24:53.903980 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.903948    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.904066 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.904007    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.904066 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.904034    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.904066 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.904056    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/030db177-0bd3-4c71-a4e6-b80e5782150d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.904172 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.904120    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.904172 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.904158    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.904266 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.904201    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnflk\" (UniqueName: \"kubernetes.io/projected/030db177-0bd3-4c71-a4e6-b80e5782150d-kube-api-access-dnflk\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.904266 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.904233    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.904363 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.904260    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.904414 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.904372    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.904490 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.904464    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.904811 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.904786    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.904929 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.904802    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.905016 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.904951    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/030db177-0bd3-4c71-a4e6-b80e5782150d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.906202 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.906186    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.906464 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.906446    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.970766 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.970739    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:53.971071 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:53.971054    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnflk\" (UniqueName: \"kubernetes.io/projected/030db177-0bd3-4c71-a4e6-b80e5782150d-kube-api-access-dnflk\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-jkdvh\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:54.103531 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:54.103513    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:24:54.530849 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:54.530824    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"]
Nov 04 01:24:54.532311 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:24:54.532289    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod030db177_0bd3_4c71_a4e6_b80e5782150d.slice/crio-af087b5f98cad8019f3fef25e4c0b3dc7c7d6115e033896dacc83f17d6f1476f WatchSource:0}: Error finding container af087b5f98cad8019f3fef25e4c0b3dc7c7d6115e033896dacc83f17d6f1476f: Status 404 returned error can't find the container with id af087b5f98cad8019f3fef25e4c0b3dc7c7d6115e033896dacc83f17d6f1476f
Nov 04 01:24:54.724597 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:54.724565    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh" event={"ID":"030db177-0bd3-4c71-a4e6-b80e5782150d","Type":"ContainerStarted","Data":"af087b5f98cad8019f3fef25e4c0b3dc7c7d6115e033896dacc83f17d6f1476f"}
Nov 04 01:24:57.923690 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:57.923621    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8944767cb-69krk"]
Nov 04 01:24:57.929921 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:57.929906    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8944767cb-69krk"
Nov 04 01:24:57.980731 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:57.980708    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8944767cb-69krk"]
Nov 04 01:24:58.034951 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:58.034919    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d558a48a-4504-40e5-be72-98e3fdbc001e-tls-cert\") pod \"authorino-8944767cb-69krk\" (UID: \"d558a48a-4504-40e5-be72-98e3fdbc001e\") " pod="kuadrant-system/authorino-8944767cb-69krk"
Nov 04 01:24:58.035128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:58.034952    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfr42\" (UniqueName: \"kubernetes.io/projected/d558a48a-4504-40e5-be72-98e3fdbc001e-kube-api-access-tfr42\") pod \"authorino-8944767cb-69krk\" (UID: \"d558a48a-4504-40e5-be72-98e3fdbc001e\") " pod="kuadrant-system/authorino-8944767cb-69krk"
Nov 04 01:24:58.136368 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:58.136335    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d558a48a-4504-40e5-be72-98e3fdbc001e-tls-cert\") pod \"authorino-8944767cb-69krk\" (UID: \"d558a48a-4504-40e5-be72-98e3fdbc001e\") " pod="kuadrant-system/authorino-8944767cb-69krk"
Nov 04 01:24:58.136499 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:58.136369    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfr42\" (UniqueName: \"kubernetes.io/projected/d558a48a-4504-40e5-be72-98e3fdbc001e-kube-api-access-tfr42\") pod \"authorino-8944767cb-69krk\" (UID: \"d558a48a-4504-40e5-be72-98e3fdbc001e\") " pod="kuadrant-system/authorino-8944767cb-69krk"
Nov 04 01:24:58.138604 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:58.138578    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d558a48a-4504-40e5-be72-98e3fdbc001e-tls-cert\") pod \"authorino-8944767cb-69krk\" (UID: \"d558a48a-4504-40e5-be72-98e3fdbc001e\") " pod="kuadrant-system/authorino-8944767cb-69krk"
Nov 04 01:24:58.202295 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:58.202237    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfr42\" (UniqueName: \"kubernetes.io/projected/d558a48a-4504-40e5-be72-98e3fdbc001e-kube-api-access-tfr42\") pod \"authorino-8944767cb-69krk\" (UID: \"d558a48a-4504-40e5-be72-98e3fdbc001e\") " pod="kuadrant-system/authorino-8944767cb-69krk"
Nov 04 01:24:58.242326 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:58.242307    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8944767cb-69krk"
Nov 04 01:24:58.617888 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:58.617864    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8944767cb-69krk"]
Nov 04 01:24:58.618846 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:24:58.618823    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd558a48a_4504_40e5_be72_98e3fdbc001e.slice/crio-32bc67d49d0ae9ff1220d8a91f0646c3f70328bb5f83cd708a42263a82230a5d WatchSource:0}: Error finding container 32bc67d49d0ae9ff1220d8a91f0646c3f70328bb5f83cd708a42263a82230a5d: Status 404 returned error can't find the container with id 32bc67d49d0ae9ff1220d8a91f0646c3f70328bb5f83cd708a42263a82230a5d
Nov 04 01:24:58.742893 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:24:58.742863    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8944767cb-69krk" event={"ID":"d558a48a-4504-40e5-be72-98e3fdbc001e","Type":"ContainerStarted","Data":"32bc67d49d0ae9ff1220d8a91f0646c3f70328bb5f83cd708a42263a82230a5d"}
Nov 04 01:25:00.753245 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:00.753160    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8944767cb-69krk" event={"ID":"d558a48a-4504-40e5-be72-98e3fdbc001e","Type":"ContainerStarted","Data":"775db91e599c7e1ea0a9d7529c84a62d2e0d4bd4420d3e5ce7fec7ee626e077d"}
Nov 04 01:25:00.871811 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:00.871767    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-8944767cb-69krk" podStartSLOduration=2.169593071 podStartE2EDuration="3.871756028s" totalImagesPullingTime="1.702162957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:25:00.871484257 +0000 UTC m=+823.423944401" watchObservedRunningTime="2026-11-04 01:25:00.871756028 +0000 UTC m=+823.424216152"
Nov 04 01:25:00.925015 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:00.924798    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cc745859-ntsd5"]
Nov 04 01:25:00.925173 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:00.925039    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-cc745859-ntsd5" podUID="a1019485-c563-4c94-a8d1-8272fecef8e7" containerName="authorino" containerID="cri-o://618d0d3db7865c960fecbb9119601e3f8f2feb60cd3c11c9c88c6af7c3a4faed" gracePeriod=30
Nov 04 01:25:01.199570 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:01.199544    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cc745859-ntsd5"
Nov 04 01:25:01.263209 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:01.263174    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a1019485-c563-4c94-a8d1-8272fecef8e7-tls-cert\" (UniqueName: \"kubernetes.io/secret/a1019485-c563-4c94-a8d1-8272fecef8e7-tls-cert\") pod \"a1019485-c563-4c94-a8d1-8272fecef8e7\" (UID: \"a1019485-c563-4c94-a8d1-8272fecef8e7\") "
Nov 04 01:25:01.263358 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:01.263311    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a1019485-c563-4c94-a8d1-8272fecef8e7-kube-api-access-68pc2\" (UniqueName: \"kubernetes.io/projected/a1019485-c563-4c94-a8d1-8272fecef8e7-kube-api-access-68pc2\") pod \"a1019485-c563-4c94-a8d1-8272fecef8e7\" (UID: \"a1019485-c563-4c94-a8d1-8272fecef8e7\") "
Nov 04 01:25:01.266047 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:01.266014    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1019485-c563-4c94-a8d1-8272fecef8e7-kube-api-access-68pc2" pod "a1019485-c563-4c94-a8d1-8272fecef8e7" (UID: "a1019485-c563-4c94-a8d1-8272fecef8e7"). InnerVolumeSpecName "kube-api-access-68pc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:25:01.274710 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:01.274677    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1019485-c563-4c94-a8d1-8272fecef8e7-tls-cert" pod "a1019485-c563-4c94-a8d1-8272fecef8e7" (UID: "a1019485-c563-4c94-a8d1-8272fecef8e7"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:25:01.364688 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:01.364648    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68pc2\" (UniqueName: \"kubernetes.io/projected/a1019485-c563-4c94-a8d1-8272fecef8e7-kube-api-access-68pc2\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:25:01.364688 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:01.364688    5640 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a1019485-c563-4c94-a8d1-8272fecef8e7-tls-cert\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:25:01.760998 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:01.760890    5640 generic.go:356] "Generic (PLEG): container finished" podID="a1019485-c563-4c94-a8d1-8272fecef8e7" containerID="618d0d3db7865c960fecbb9119601e3f8f2feb60cd3c11c9c88c6af7c3a4faed" exitCode=0
Nov 04 01:25:01.762582 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:01.762559    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cc745859-ntsd5"
Nov 04 01:25:01.762946 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:01.762927    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cc745859-ntsd5" event={"ID":"a1019485-c563-4c94-a8d1-8272fecef8e7","Type":"ContainerDied","Data":"618d0d3db7865c960fecbb9119601e3f8f2feb60cd3c11c9c88c6af7c3a4faed"}
Nov 04 01:25:01.763086 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:01.762964    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cc745859-ntsd5" event={"ID":"a1019485-c563-4c94-a8d1-8272fecef8e7","Type":"ContainerDied","Data":"85e8cbc08e4881005801c835e81faed6ce472c9c9f6f35f4d544ad0e9f456675"}
Nov 04 01:25:01.763086 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:01.763004    5640 scope.go:122] "RemoveContainer" containerID="618d0d3db7865c960fecbb9119601e3f8f2feb60cd3c11c9c88c6af7c3a4faed"
Nov 04 01:25:01.772422 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:01.772406    5640 scope.go:122] "RemoveContainer" containerID="618d0d3db7865c960fecbb9119601e3f8f2feb60cd3c11c9c88c6af7c3a4faed"
Nov 04 01:25:01.772751 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:25:01.772694    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"618d0d3db7865c960fecbb9119601e3f8f2feb60cd3c11c9c88c6af7c3a4faed\": container with ID starting with 618d0d3db7865c960fecbb9119601e3f8f2feb60cd3c11c9c88c6af7c3a4faed not found: ID does not exist" containerID="618d0d3db7865c960fecbb9119601e3f8f2feb60cd3c11c9c88c6af7c3a4faed"
Nov 04 01:25:01.772751 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:01.772730    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"618d0d3db7865c960fecbb9119601e3f8f2feb60cd3c11c9c88c6af7c3a4faed"} err="failed to get container status \"618d0d3db7865c960fecbb9119601e3f8f2feb60cd3c11c9c88c6af7c3a4faed\": rpc error: code = NotFound desc = could not find container \"618d0d3db7865c960fecbb9119601e3f8f2feb60cd3c11c9c88c6af7c3a4faed\": container with ID starting with 618d0d3db7865c960fecbb9119601e3f8f2feb60cd3c11c9c88c6af7c3a4faed not found: ID does not exist"
Nov 04 01:25:01.942948 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:01.942916    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cc745859-ntsd5"]
Nov 04 01:25:01.994428 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:01.994400    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-cc745859-ntsd5"]
Nov 04 01:25:03.064651 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:03.064615    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:25:03.065061 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:03.064699    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:25:03.065061 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:03.064750    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:25:03.575990 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:03.574008    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a1019485-c563-4c94-a8d1-8272fecef8e7" path="/var/lib/kubelet/pods/a1019485-c563-4c94-a8d1-8272fecef8e7/volumes"
Nov 04 01:25:03.777462 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:03.777424    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh" event={"ID":"030db177-0bd3-4c71-a4e6-b80e5782150d","Type":"ContainerStarted","Data":"7eccba68f5481ca6c5d914862d42b67414d9e13ba459684f357a69ca639131db"}
Nov 04 01:25:03.968293 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:03.968173    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh" podStartSLOduration=2.438523007 podStartE2EDuration="10.968151532s" totalImagesPullingTime="8.529628525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:24:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:25:03.962568142 +0000 UTC m=+826.515028296" watchObservedRunningTime="2026-11-04 01:25:03.968151532 +0000 UTC m=+826.520611658"
Nov 04 01:25:04.104284 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:04.104252    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:25:04.105847 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:04.105824    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Nov 04 01:25:04.105960 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:04.105875    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh" podUID="030db177-0bd3-4c71-a4e6-b80e5782150d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Nov 04 01:25:05.104280 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:05.104243    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Nov 04 01:25:05.104441 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:05.104304    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh" podUID="030db177-0bd3-4c71-a4e6-b80e5782150d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Nov 04 01:25:06.104761 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:06.104731    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Nov 04 01:25:06.105138 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:06.104791    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh" podUID="030db177-0bd3-4c71-a4e6-b80e5782150d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Nov 04 01:25:07.104813 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:07.104774    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Nov 04 01:25:07.105227 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:07.104850    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh" podUID="030db177-0bd3-4c71-a4e6-b80e5782150d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Nov 04 01:25:08.104019 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:08.103986    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Nov 04 01:25:08.104199 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:08.104062    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh" podUID="030db177-0bd3-4c71-a4e6-b80e5782150d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Nov 04 01:25:09.104531 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:09.104498    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:25:09.104885 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:09.104735    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Nov 04 01:25:09.104885 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:09.104793    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh" podUID="030db177-0bd3-4c71-a4e6-b80e5782150d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Nov 04 01:25:10.104365 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:10.104327    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Nov 04 01:25:10.104530 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:10.104388    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh" podUID="030db177-0bd3-4c71-a4e6-b80e5782150d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Nov 04 01:25:11.142425 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:25:11.142384    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:25:11.426686 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:11.426596    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:25:11.427892 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:25:11.427865    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:25:41.147727 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:25:41.147692    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:26:10.226134 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.226103    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"]
Nov 04 01:26:10.226595 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.226445    5640 cpu_manager.go:414] "containerMap: removing container" podUID="a1019485-c563-4c94-a8d1-8272fecef8e7" containerName="authorino"
Nov 04 01:26:10.226595 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.226455    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a1019485-c563-4c94-a8d1-8272fecef8e7" containerName="authorino"
Nov 04 01:26:10.226595 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.226560    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="a1019485-c563-4c94-a8d1-8272fecef8e7" containerName="authorino"
Nov 04 01:26:10.229436 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.229421    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.320095 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.320067    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"]
Nov 04 01:26:10.367084 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.367054    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-workload-certs\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.367221 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.367118    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-data\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.367221 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.367208    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-podinfo\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.367297 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.367245    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-workload-socket\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.367297 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.367279    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-credential-socket\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.367381 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.367338    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f269r\" (UniqueName: \"kubernetes.io/projected/3a3a0f69-18a0-4089-a37e-2034c873bde6-kube-api-access-f269r\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.367381 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.367360    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-envoy\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.367446 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.367382    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-token\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.367446 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.367423    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a3a0f69-18a0-4089-a37e-2034c873bde6-istiod-ca-cert\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.370173 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.370154    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-00cfe6-openshift-default-dockercfg-5jwvp\""
Nov 04 01:26:10.469517 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.469479    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-credential-socket\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.469692 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.469550    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f269r\" (UniqueName: \"kubernetes.io/projected/3a3a0f69-18a0-4089-a37e-2034c873bde6-kube-api-access-f269r\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.469692 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.469592    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-envoy\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.469692 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.469635    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-token\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.469839 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.469703    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a3a0f69-18a0-4089-a37e-2034c873bde6-istiod-ca-cert\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.469839 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.469768    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-workload-certs\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.469931 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.469840    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-data\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.469931 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.469887    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-podinfo\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.469931 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.469920    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-workload-socket\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.470409 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.470382    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-workload-socket\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.470655 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.470634    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-credential-socket\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.472658 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.472632    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a3a0f69-18a0-4089-a37e-2034c873bde6-istiod-ca-cert\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.473192 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.472807    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-data\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.473356 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.473335    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-workload-certs\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.476649 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.476601    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-envoy\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.477684 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.477649    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-podinfo\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.534929 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.534900    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f269r\" (UniqueName: \"kubernetes.io/projected/3a3a0f69-18a0-4089-a37e-2034c873bde6-kube-api-access-f269r\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.535363 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.535345    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-token\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.546087 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.546070    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:10.983743 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.983719    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"]
Nov 04 01:26:10.984392 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:26:10.984366    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a3a0f69_18a0_4089_a37e_2034c873bde6.slice/crio-9baff459d05e7f0291266cabde5c1387fe7d6336fdb074f197fa8c47306fa2b1 WatchSource:0}: Error finding container 9baff459d05e7f0291266cabde5c1387fe7d6336fdb074f197fa8c47306fa2b1: Status 404 returned error can't find the container with id 9baff459d05e7f0291266cabde5c1387fe7d6336fdb074f197fa8c47306fa2b1
Nov 04 01:26:10.986401 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.986367    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:26:10.986510 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.986429    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:26:10.986510 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:10.986459    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:26:11.080711 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:11.080673    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr" event={"ID":"3a3a0f69-18a0-4089-a37e-2034c873bde6","Type":"ContainerStarted","Data":"215ef5acda28cceb7367311e1c4ad5a13d6147f9db5f7969d218e555f5e0e4dc"}
Nov 04 01:26:11.080876 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:11.080740    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr" event={"ID":"3a3a0f69-18a0-4089-a37e-2034c873bde6","Type":"ContainerStarted","Data":"9baff459d05e7f0291266cabde5c1387fe7d6336fdb074f197fa8c47306fa2b1"}
Nov 04 01:26:11.142931 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:26:11.142903    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:26:11.206570 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:11.206509    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr" podStartSLOduration=1.206491231 podStartE2EDuration="1.206491231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:26:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:26:11.206173323 +0000 UTC m=+893.758633443" watchObservedRunningTime="2026-11-04 01:26:11.206491231 +0000 UTC m=+893.758951357"
Nov 04 01:26:11.546167 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:11.546142    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:12.550997 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:12.550956    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:13.090588 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:13.090554    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:13.091370 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:13.091351    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:17.334486 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.334454    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"]
Nov 04 01:26:17.338019 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.338001    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.392170 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.392147    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-1baf54-openshift-default-dockercfg-hnfrz\""
Nov 04 01:26:17.430479 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.430445    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e678048d-06f8-4101-85e2-b0c5d125238a-istio-token\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.430614 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.430489    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-istio-envoy\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.430614 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.430513    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e678048d-06f8-4101-85e2-b0c5d125238a-istiod-ca-cert\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.430736 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.430682    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-istio-data\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.430797 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.430752    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-workload-socket\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.430797 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.430790    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-credential-socket\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.430874 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.430848    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlb7g\" (UniqueName: \"kubernetes.io/projected/e678048d-06f8-4101-85e2-b0c5d125238a-kube-api-access-tlb7g\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.430936 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.430920    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-workload-certs\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.431071 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.431055    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e678048d-06f8-4101-85e2-b0c5d125238a-istio-podinfo\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.444921 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.444897    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"]
Nov 04 01:26:17.532135 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.532109    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-istio-data\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.532305 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.532160    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-workload-socket\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.532305 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.532193    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-credential-socket\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.532305 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.532222    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlb7g\" (UniqueName: \"kubernetes.io/projected/e678048d-06f8-4101-85e2-b0c5d125238a-kube-api-access-tlb7g\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.532305 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.532273    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-workload-certs\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.532522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.532357    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e678048d-06f8-4101-85e2-b0c5d125238a-istio-podinfo\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.532522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.532386    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e678048d-06f8-4101-85e2-b0c5d125238a-istio-token\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.532522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.532416    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-istio-envoy\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.532672 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.532550    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-istio-data\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.532672 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.532438    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e678048d-06f8-4101-85e2-b0c5d125238a-istiod-ca-cert\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.532672 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.532583    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-workload-socket\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.532822 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.532774    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-workload-certs\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.532883 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.532840    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-credential-socket\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.533212 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.533191    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e678048d-06f8-4101-85e2-b0c5d125238a-istiod-ca-cert\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.534737 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.534710    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-istio-envoy\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.535128 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.535109    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e678048d-06f8-4101-85e2-b0c5d125238a-istio-podinfo\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.594587 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.594535    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e678048d-06f8-4101-85e2-b0c5d125238a-istio-token\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.594898 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.594877    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlb7g\" (UniqueName: \"kubernetes.io/projected/e678048d-06f8-4101-85e2-b0c5d125238a-kube-api-access-tlb7g\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:17.703723 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.703696    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-1baf54-openshift-default-dockercfg-hnfrz\""
Nov 04 01:26:17.711800 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:17.711783    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:18.139367 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:18.139344    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"]
Nov 04 01:26:18.140351 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:26:18.140325    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode678048d_06f8_4101_85e2_b0c5d125238a.slice/crio-2429ac9c1e5ff39f9d11b454839a18c57d1f0815ff52006dfe95e4ac592c8565 WatchSource:0}: Error finding container 2429ac9c1e5ff39f9d11b454839a18c57d1f0815ff52006dfe95e4ac592c8565: Status 404 returned error can't find the container with id 2429ac9c1e5ff39f9d11b454839a18c57d1f0815ff52006dfe95e4ac592c8565
Nov 04 01:26:18.142394 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:18.142361    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:26:18.142474 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:18.142438    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:26:18.142474 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:18.142468    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:26:18.418288 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:18.418217    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt"]
Nov 04 01:26:18.421790 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:18.421772    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt"
Nov 04 01:26:18.477451 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:18.477410    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt"]
Nov 04 01:26:18.477618 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:18.477577    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w3-9f7183\""
Nov 04 01:26:18.532440 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:18.532409    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w3-9f7183-dockercfg-9gdcm\""
Nov 04 01:26:18.542741 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:18.542715    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad129c82-d850-4d18-97cc-707534ab121a-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt\" (UID: \"ad129c82-d850-4d18-97cc-707534ab121a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt"
Nov 04 01:26:18.542890 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:18.542774    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hldwq\" (UniqueName: \"kubernetes.io/projected/ad129c82-d850-4d18-97cc-707534ab121a-kube-api-access-hldwq\") pod \"payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt\" (UID: \"ad129c82-d850-4d18-97cc-707534ab121a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt"
Nov 04 01:26:18.643338 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:18.643307    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad129c82-d850-4d18-97cc-707534ab121a-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt\" (UID: \"ad129c82-d850-4d18-97cc-707534ab121a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt"
Nov 04 01:26:18.643491 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:18.643362    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hldwq\" (UniqueName: \"kubernetes.io/projected/ad129c82-d850-4d18-97cc-707534ab121a-kube-api-access-hldwq\") pod \"payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt\" (UID: \"ad129c82-d850-4d18-97cc-707534ab121a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt"
Nov 04 01:26:18.644313 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:18.644295    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad129c82-d850-4d18-97cc-707534ab121a-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt\" (UID: \"ad129c82-d850-4d18-97cc-707534ab121a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt"
Nov 04 01:26:18.706156 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:18.706101    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hldwq\" (UniqueName: \"kubernetes.io/projected/ad129c82-d850-4d18-97cc-707534ab121a-kube-api-access-hldwq\") pod \"payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt\" (UID: \"ad129c82-d850-4d18-97cc-707534ab121a\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt"
Nov 04 01:26:18.735910 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:18.735886    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt"
Nov 04 01:26:19.108315 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:19.108293    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt"]
Nov 04 01:26:19.111443 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:26:19.109956    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad129c82_d850_4d18_97cc_707534ab121a.slice/crio-e769154269f26b4812da3f73146334d0ba5900ee6e429d2f4153cb43df150410 WatchSource:0}: Error finding container e769154269f26b4812da3f73146334d0ba5900ee6e429d2f4153cb43df150410: Status 404 returned error can't find the container with id e769154269f26b4812da3f73146334d0ba5900ee6e429d2f4153cb43df150410
Nov 04 01:26:19.119321 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:19.119285    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt" event={"ID":"ad129c82-d850-4d18-97cc-707534ab121a","Type":"ContainerStarted","Data":"e769154269f26b4812da3f73146334d0ba5900ee6e429d2f4153cb43df150410"}
Nov 04 01:26:19.120941 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:19.120915    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978" event={"ID":"e678048d-06f8-4101-85e2-b0c5d125238a","Type":"ContainerStarted","Data":"3357eb8596482ff47260ceedd79ebe50ad3b9ab7cd287693d454a1f201ebb234"}
Nov 04 01:26:19.121047 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:19.120964    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978" event={"ID":"e678048d-06f8-4101-85e2-b0c5d125238a","Type":"ContainerStarted","Data":"2429ac9c1e5ff39f9d11b454839a18c57d1f0815ff52006dfe95e4ac592c8565"}
Nov 04 01:26:19.246268 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:19.246228    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978" podStartSLOduration=2.246216788 podStartE2EDuration="2.246216788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:26:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:26:19.244827251 +0000 UTC m=+901.797287376" watchObservedRunningTime="2026-11-04 01:26:19.246216788 +0000 UTC m=+901.798676914"
Nov 04 01:26:19.712364 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:19.712336    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:19.717106 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:19.717083    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:20.133029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:20.132959    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt" event={"ID":"ad129c82-d850-4d18-97cc-707534ab121a","Type":"ContainerStarted","Data":"81c2229c6a17f3600e569499a69f1bab3b10d077eac805103bc08da1d62a2fc2"}
Nov 04 01:26:20.133523 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:20.133295    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt"
Nov 04 01:26:20.133523 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:20.133325    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:20.134295 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:20.134276    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:26:20.251196 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:20.251134    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt" podStartSLOduration=2.251120383 podStartE2EDuration="2.251120383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:26:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:26:20.251079188 +0000 UTC m=+902.803539333" watchObservedRunningTime="2026-11-04 01:26:20.251120383 +0000 UTC m=+902.803580504"
Nov 04 01:26:20.923532 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:20.923503    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"]
Nov 04 01:26:20.927218 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:20.927201    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"
Nov 04 01:26:20.982949 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:20.982925    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"]
Nov 04 01:26:21.032923 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:21.032905    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-9f7183-serving-cert\""
Nov 04 01:26:21.065238 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:21.065211    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78\" (UID: \"abfac0e2-8f66-48b7-a64d-0f9a86f206a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"
Nov 04 01:26:21.065357 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:21.065246    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-maas-api-tls\") pod \"maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78\" (UID: \"abfac0e2-8f66-48b7-a64d-0f9a86f206a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"
Nov 04 01:26:21.065357 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:21.065266    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-metrics-certs\") pod \"maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78\" (UID: \"abfac0e2-8f66-48b7-a64d-0f9a86f206a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"
Nov 04 01:26:21.065357 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:21.065303    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv4hn\" (UniqueName: \"kubernetes.io/projected/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-kube-api-access-lv4hn\") pod \"maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78\" (UID: \"abfac0e2-8f66-48b7-a64d-0f9a86f206a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"
Nov 04 01:26:21.166028 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:21.166002    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-maas-api-tls\") pod \"maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78\" (UID: \"abfac0e2-8f66-48b7-a64d-0f9a86f206a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"
Nov 04 01:26:21.166028 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:21.166030    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-metrics-certs\") pod \"maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78\" (UID: \"abfac0e2-8f66-48b7-a64d-0f9a86f206a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"
Nov 04 01:26:21.166187 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:21.166060    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv4hn\" (UniqueName: \"kubernetes.io/projected/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-kube-api-access-lv4hn\") pod \"maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78\" (UID: \"abfac0e2-8f66-48b7-a64d-0f9a86f206a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"
Nov 04 01:26:21.166187 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:26:21.166142    5640 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-serving-cert: secret "maas-api-e2e-worker-w3-9f7183-serving-cert" not found
Nov 04 01:26:21.166187 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:21.166173    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78\" (UID: \"abfac0e2-8f66-48b7-a64d-0f9a86f206a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"
Nov 04 01:26:21.166298 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:26:21.166218    5640 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-maas-api-tls podName:abfac0e2-8f66-48b7-a64d-0f9a86f206a5 nodeName:}" failed. No retries permitted until 2026-11-04 01:26:21.666200926 +0000 UTC m=+904.218661043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-maas-api-tls") pod "maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78" (UID: "abfac0e2-8f66-48b7-a64d-0f9a86f206a5") : secret "maas-api-e2e-worker-w3-9f7183-serving-cert" not found
Nov 04 01:26:21.166784 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:21.166763    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78\" (UID: \"abfac0e2-8f66-48b7-a64d-0f9a86f206a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"
Nov 04 01:26:21.168326 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:21.168309    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-metrics-certs\") pod \"maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78\" (UID: \"abfac0e2-8f66-48b7-a64d-0f9a86f206a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"
Nov 04 01:26:21.230923 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:21.230867    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv4hn\" (UniqueName: \"kubernetes.io/projected/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-kube-api-access-lv4hn\") pod \"maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78\" (UID: \"abfac0e2-8f66-48b7-a64d-0f9a86f206a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"
Nov 04 01:26:21.671221 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:21.671194    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-maas-api-tls\") pod \"maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78\" (UID: \"abfac0e2-8f66-48b7-a64d-0f9a86f206a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"
Nov 04 01:26:21.673381 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:21.673357    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-maas-api-tls\") pod \"maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78\" (UID: \"abfac0e2-8f66-48b7-a64d-0f9a86f206a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"
Nov 04 01:26:21.840372 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:21.840351    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"
Nov 04 01:26:22.219709 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:22.219689    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"]
Nov 04 01:26:22.221493 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:26:22.221460    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabfac0e2_8f66_48b7_a64d_0f9a86f206a5.slice/crio-4fb8765f01a28579a649c6d88776b3445c97e915e252a3a06648746d0320f854 WatchSource:0}: Error finding container 4fb8765f01a28579a649c6d88776b3445c97e915e252a3a06648746d0320f854: Status 404 returned error can't find the container with id 4fb8765f01a28579a649c6d88776b3445c97e915e252a3a06648746d0320f854
Nov 04 01:26:23.149184 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:23.149146    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78" event={"ID":"abfac0e2-8f66-48b7-a64d-0f9a86f206a5","Type":"ContainerStarted","Data":"4fb8765f01a28579a649c6d88776b3445c97e915e252a3a06648746d0320f854"}
Nov 04 01:26:24.155172 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:24.155136    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78" event={"ID":"abfac0e2-8f66-48b7-a64d-0f9a86f206a5","Type":"ContainerStarted","Data":"2d74cf4c7183ddf93c67d33ae71538f06034add47669c9f11ed4ec195962bb2d"}
Nov 04 01:26:24.155512 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:24.155226    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"
Nov 04 01:26:24.283130 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:24.283082    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78" podStartSLOduration=3.333941456 podStartE2EDuration="4.283068078s" totalImagesPullingTime="949.126622ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:26:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:26:24.282202833 +0000 UTC m=+906.834662958" watchObservedRunningTime="2026-11-04 01:26:24.283068078 +0000 UTC m=+906.835528230"
Nov 04 01:26:30.164441 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:30.164370    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"
Nov 04 01:26:30.273430 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:30.273404    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6"]
Nov 04 01:26:30.277069 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:30.277052    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6"
Nov 04 01:26:30.326151 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:30.326122    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6"]
Nov 04 01:26:30.331355 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:30.331333    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-00cfe6\""
Nov 04 01:26:30.338027 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:30.338007    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-00cfe6-dockercfg-rjtmq\""
Nov 04 01:26:30.444988 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:30.444906    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/477de01d-712a-435c-a3e1-afb1b9d6b8d4-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6\" (UID: \"477de01d-712a-435c-a3e1-afb1b9d6b8d4\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6"
Nov 04 01:26:30.445092 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:30.445030    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksft8\" (UniqueName: \"kubernetes.io/projected/477de01d-712a-435c-a3e1-afb1b9d6b8d4-kube-api-access-ksft8\") pod \"payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6\" (UID: \"477de01d-712a-435c-a3e1-afb1b9d6b8d4\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6"
Nov 04 01:26:30.545761 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:30.545738    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/477de01d-712a-435c-a3e1-afb1b9d6b8d4-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6\" (UID: \"477de01d-712a-435c-a3e1-afb1b9d6b8d4\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6"
Nov 04 01:26:30.545884 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:30.545807    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksft8\" (UniqueName: \"kubernetes.io/projected/477de01d-712a-435c-a3e1-afb1b9d6b8d4-kube-api-access-ksft8\") pod \"payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6\" (UID: \"477de01d-712a-435c-a3e1-afb1b9d6b8d4\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6"
Nov 04 01:26:30.546466 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:30.546445    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/477de01d-712a-435c-a3e1-afb1b9d6b8d4-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6\" (UID: \"477de01d-712a-435c-a3e1-afb1b9d6b8d4\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6"
Nov 04 01:26:30.607955 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:30.607928    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksft8\" (UniqueName: \"kubernetes.io/projected/477de01d-712a-435c-a3e1-afb1b9d6b8d4-kube-api-access-ksft8\") pod \"payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6\" (UID: \"477de01d-712a-435c-a3e1-afb1b9d6b8d4\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6"
Nov 04 01:26:30.891293 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:30.891267    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6"
Nov 04 01:26:31.140498 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:31.140471    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt"
Nov 04 01:26:31.267410 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:31.267385    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6"]
Nov 04 01:26:31.269883 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:26:31.269857    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod477de01d_712a_435c_a3e1_afb1b9d6b8d4.slice/crio-9213f769e7c5b522335710f8f0a9d75a49ea9a1f0cf2b861edf7c63dd9be2f91 WatchSource:0}: Error finding container 9213f769e7c5b522335710f8f0a9d75a49ea9a1f0cf2b861edf7c63dd9be2f91: Status 404 returned error can't find the container with id 9213f769e7c5b522335710f8f0a9d75a49ea9a1f0cf2b861edf7c63dd9be2f91
Nov 04 01:26:32.191135 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:32.191095    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6" event={"ID":"477de01d-712a-435c-a3e1-afb1b9d6b8d4","Type":"ContainerStarted","Data":"17aea24896c7a846ea46d5daea403172111d46875ee4cba0cd0f1dd803f63f0d"}
Nov 04 01:26:32.191306 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:32.191160    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6" event={"ID":"477de01d-712a-435c-a3e1-afb1b9d6b8d4","Type":"ContainerStarted","Data":"9213f769e7c5b522335710f8f0a9d75a49ea9a1f0cf2b861edf7c63dd9be2f91"}
Nov 04 01:26:32.191306 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:32.191189    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6"
Nov 04 01:26:32.315642 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:32.315590    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6" podStartSLOduration=2.315577372 podStartE2EDuration="2.315577372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:26:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:26:32.314884921 +0000 UTC m=+914.867345058" watchObservedRunningTime="2026-11-04 01:26:32.315577372 +0000 UTC m=+914.868037498"
Nov 04 01:26:32.648992 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:32.648951    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk"]
Nov 04 01:26:32.652638 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:32.652612    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk"
Nov 04 01:26:32.667406 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:32.667385    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8sbd\" (UniqueName: \"kubernetes.io/projected/88358137-e0c0-4b1b-8d07-a64187fcde9f-kube-api-access-k8sbd\") pod \"payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk\" (UID: \"88358137-e0c0-4b1b-8d07-a64187fcde9f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk"
Nov 04 01:26:32.667511 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:32.667490    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88358137-e0c0-4b1b-8d07-a64187fcde9f-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk\" (UID: \"88358137-e0c0-4b1b-8d07-a64187fcde9f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk"
Nov 04 01:26:32.706513 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:32.706486    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk"]
Nov 04 01:26:32.706940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:32.706925    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-a96a99\""
Nov 04 01:26:32.756283 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:32.756252    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-a96a99-dockercfg-76xbk\""
Nov 04 01:26:32.768482 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:32.768451    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8sbd\" (UniqueName: \"kubernetes.io/projected/88358137-e0c0-4b1b-8d07-a64187fcde9f-kube-api-access-k8sbd\") pod \"payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk\" (UID: \"88358137-e0c0-4b1b-8d07-a64187fcde9f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk"
Nov 04 01:26:32.768622 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:32.768529    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88358137-e0c0-4b1b-8d07-a64187fcde9f-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk\" (UID: \"88358137-e0c0-4b1b-8d07-a64187fcde9f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk"
Nov 04 01:26:32.769286 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:32.769265    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88358137-e0c0-4b1b-8d07-a64187fcde9f-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk\" (UID: \"88358137-e0c0-4b1b-8d07-a64187fcde9f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk"
Nov 04 01:26:32.836716 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:32.836690    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8sbd\" (UniqueName: \"kubernetes.io/projected/88358137-e0c0-4b1b-8d07-a64187fcde9f-kube-api-access-k8sbd\") pod \"payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk\" (UID: \"88358137-e0c0-4b1b-8d07-a64187fcde9f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk"
Nov 04 01:26:32.966037 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:32.965957    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk"
Nov 04 01:26:33.336995 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:33.336958    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk"]
Nov 04 01:26:33.337894 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:26:33.337868    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88358137_e0c0_4b1b_8d07_a64187fcde9f.slice/crio-48ca49fc334aab6a8f7aaaea2cb49d66586d13a86f0b96f909de00df6cb40455 WatchSource:0}: Error finding container 48ca49fc334aab6a8f7aaaea2cb49d66586d13a86f0b96f909de00df6cb40455: Status 404 returned error can't find the container with id 48ca49fc334aab6a8f7aaaea2cb49d66586d13a86f0b96f909de00df6cb40455
Nov 04 01:26:34.202764 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:34.202730    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk" event={"ID":"88358137-e0c0-4b1b-8d07-a64187fcde9f","Type":"ContainerStarted","Data":"482bf16de352047ddd2e7387bb4967cf049cf81bec48aa5aafabca31ef4cda1c"}
Nov 04 01:26:34.202933 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:34.202824    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk" event={"ID":"88358137-e0c0-4b1b-8d07-a64187fcde9f","Type":"ContainerStarted","Data":"48ca49fc334aab6a8f7aaaea2cb49d66586d13a86f0b96f909de00df6cb40455"}
Nov 04 01:26:34.202933 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:34.202847    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk"
Nov 04 01:26:34.322216 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:34.322171    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk" podStartSLOduration=2.322158582 podStartE2EDuration="2.322158582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:26:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:26:34.321296353 +0000 UTC m=+916.873756479" watchObservedRunningTime="2026-11-04 01:26:34.322158582 +0000 UTC m=+916.874618707"
Nov 04 01:26:41.140327 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:26:41.140293    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:26:42.662420 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:42.662389    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"]
Nov 04 01:26:42.665955 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:42.665937    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"
Nov 04 01:26:42.761683 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:42.761649    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n6nn\" (UniqueName: \"kubernetes.io/projected/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-kube-api-access-7n6nn\") pod \"maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j\" (UID: \"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"
Nov 04 01:26:42.761819 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:42.761717    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j\" (UID: \"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"
Nov 04 01:26:42.761819 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:42.761797    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-metrics-certs\") pod \"maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j\" (UID: \"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"
Nov 04 01:26:42.761907 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:42.761838    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-maas-api-tls\") pod \"maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j\" (UID: \"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"
Nov 04 01:26:42.771292 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:42.771267    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-a96a99-serving-cert\""
Nov 04 01:26:42.772981 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:42.772954    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"]
Nov 04 01:26:42.862296 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:42.862266    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n6nn\" (UniqueName: \"kubernetes.io/projected/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-kube-api-access-7n6nn\") pod \"maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j\" (UID: \"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"
Nov 04 01:26:42.862425 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:42.862332    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j\" (UID: \"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"
Nov 04 01:26:42.862425 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:42.862375    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-metrics-certs\") pod \"maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j\" (UID: \"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"
Nov 04 01:26:42.862425 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:42.862417    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-maas-api-tls\") pod \"maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j\" (UID: \"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"
Nov 04 01:26:42.862553 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:26:42.862539    5640 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-serving-cert: secret "maas-api-e2e-worker-w0-a96a99-serving-cert" not found
Nov 04 01:26:42.862620 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:26:42.862611    5640 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-maas-api-tls podName:1de203aa-f594-4c62-a8e6-2dc9c93a4b4d nodeName:}" failed. No retries permitted until 2026-11-04 01:26:43.362595492 +0000 UTC m=+925.915055606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-maas-api-tls") pod "maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j" (UID: "1de203aa-f594-4c62-a8e6-2dc9c93a4b4d") : secret "maas-api-e2e-worker-w0-a96a99-serving-cert" not found
Nov 04 01:26:42.863012 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:42.862995    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j\" (UID: \"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"
Nov 04 01:26:42.864732 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:42.864712    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-metrics-certs\") pod \"maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j\" (UID: \"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"
Nov 04 01:26:42.925518 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:42.925455    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n6nn\" (UniqueName: \"kubernetes.io/projected/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-kube-api-access-7n6nn\") pod \"maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j\" (UID: \"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"
Nov 04 01:26:43.199247 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:43.199170    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6"
Nov 04 01:26:43.366997 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:43.366936    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-maas-api-tls\") pod \"maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j\" (UID: \"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"
Nov 04 01:26:43.369289 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:43.369266    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-maas-api-tls\") pod \"maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j\" (UID: \"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"
Nov 04 01:26:43.578198 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:43.578171    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"
Nov 04 01:26:43.957079 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:43.957052    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"]
Nov 04 01:26:43.958463 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:26:43.958439    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1de203aa_f594_4c62_a8e6_2dc9c93a4b4d.slice/crio-d2f3de3a36cd17dfbcd2a602b048ed794983d3ff23addbec943a3ca1b95f35e8 WatchSource:0}: Error finding container d2f3de3a36cd17dfbcd2a602b048ed794983d3ff23addbec943a3ca1b95f35e8: Status 404 returned error can't find the container with id d2f3de3a36cd17dfbcd2a602b048ed794983d3ff23addbec943a3ca1b95f35e8
Nov 04 01:26:44.251446 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:44.251376    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j" event={"ID":"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d","Type":"ContainerStarted","Data":"d2f3de3a36cd17dfbcd2a602b048ed794983d3ff23addbec943a3ca1b95f35e8"}
Nov 04 01:26:45.210595 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:45.210521    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk"
Nov 04 01:26:45.257416 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:45.257376    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j" event={"ID":"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d","Type":"ContainerStarted","Data":"d908d4f601942acd7cc7860d3613c9fa74b5fab43fd36854387b6fc42416d75c"}
Nov 04 01:26:45.257646 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:45.257452    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"
Nov 04 01:26:45.453075 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:45.453026    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j" podStartSLOduration=2.473709016 podStartE2EDuration="3.453012955s" totalImagesPullingTime="979.303939ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:26:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:26:45.451384861 +0000 UTC m=+928.003845035" watchObservedRunningTime="2026-11-04 01:26:45.453012955 +0000 UTC m=+928.005473081"
Nov 04 01:26:51.271778 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:51.271744    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"
Nov 04 01:26:55.317652 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:55.317621    5640 generic.go:356] "Generic (PLEG): container finished" podID="3a3a0f69-18a0-4089-a37e-2034c873bde6" containerID="215ef5acda28cceb7367311e1c4ad5a13d6147f9db5f7969d218e555f5e0e4dc" exitCode=0
Nov 04 01:26:55.318099 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:55.317694    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr" event={"ID":"3a3a0f69-18a0-4089-a37e-2034c873bde6","Type":"ContainerDied","Data":"215ef5acda28cceb7367311e1c4ad5a13d6147f9db5f7969d218e555f5e0e4dc"}
Nov 04 01:26:55.318150 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:55.318129    5640 scope.go:122] "RemoveContainer" containerID="215ef5acda28cceb7367311e1c4ad5a13d6147f9db5f7969d218e555f5e0e4dc"
Nov 04 01:26:55.319301 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:55.319270    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:26:55.319408 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:55.319349    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:26:55.319408 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:55.319397    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:26:56.327047 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:56.327016    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr" event={"ID":"3a3a0f69-18a0-4089-a37e-2034c873bde6","Type":"ContainerStarted","Data":"e01ba0f13362b9ad02a463c613e9c2d020e1d576ec6557df580e5125ab74feaa"}
Nov 04 01:26:56.568992 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:56.564250    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:56.568992 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:56.568627    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp"]
Nov 04 01:26:56.568992 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:56.568697    5640 patch_prober.go:29] interesting pod/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 04 01:26:56.568992 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:56.568748    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr" podUID="3a3a0f69-18a0-4089-a37e-2034c873bde6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 04 01:26:56.572500 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:56.572478    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp"
Nov 04 01:26:56.626437 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:56.626398    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp"]
Nov 04 01:26:56.626776 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:56.626754    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-b2eadb\""
Nov 04 01:26:56.626964 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:56.626882    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-b2eadb-dockercfg-slwq9\""
Nov 04 01:26:56.639493 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:56.639467    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b471b303-951d-4e37-8046-5b6587e12e93-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp\" (UID: \"b471b303-951d-4e37-8046-5b6587e12e93\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp"
Nov 04 01:26:56.639599 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:56.639527    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf9j5\" (UniqueName: \"kubernetes.io/projected/b471b303-951d-4e37-8046-5b6587e12e93-kube-api-access-hf9j5\") pod \"payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp\" (UID: \"b471b303-951d-4e37-8046-5b6587e12e93\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp"
Nov 04 01:26:56.740732 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:56.740700    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b471b303-951d-4e37-8046-5b6587e12e93-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp\" (UID: \"b471b303-951d-4e37-8046-5b6587e12e93\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp"
Nov 04 01:26:56.740889 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:56.740742    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf9j5\" (UniqueName: \"kubernetes.io/projected/b471b303-951d-4e37-8046-5b6587e12e93-kube-api-access-hf9j5\") pod \"payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp\" (UID: \"b471b303-951d-4e37-8046-5b6587e12e93\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp"
Nov 04 01:26:56.741456 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:56.741435    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b471b303-951d-4e37-8046-5b6587e12e93-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp\" (UID: \"b471b303-951d-4e37-8046-5b6587e12e93\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp"
Nov 04 01:26:56.804604 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:56.804569    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf9j5\" (UniqueName: \"kubernetes.io/projected/b471b303-951d-4e37-8046-5b6587e12e93-kube-api-access-hf9j5\") pod \"payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp\" (UID: \"b471b303-951d-4e37-8046-5b6587e12e93\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp"
Nov 04 01:26:56.884568 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:56.884488    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp"
Nov 04 01:26:57.270864 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:57.270835    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp"]
Nov 04 01:26:57.272543 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:26:57.272507    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb471b303_951d_4e37_8046_5b6587e12e93.slice/crio-2007eee8aca60fd4620ec2d85a9f61606fa453ea5ccfa8979fd8af2912450866 WatchSource:0}: Error finding container 2007eee8aca60fd4620ec2d85a9f61606fa453ea5ccfa8979fd8af2912450866: Status 404 returned error can't find the container with id 2007eee8aca60fd4620ec2d85a9f61606fa453ea5ccfa8979fd8af2912450866
Nov 04 01:26:57.334154 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:57.334125    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp" event={"ID":"b471b303-951d-4e37-8046-5b6587e12e93","Type":"ContainerStarted","Data":"2007eee8aca60fd4620ec2d85a9f61606fa453ea5ccfa8979fd8af2912450866"}
Nov 04 01:26:57.334502 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:57.334415    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp"
Nov 04 01:26:57.457992 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:57.455853    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp" podStartSLOduration=1.455833974 podStartE2EDuration="1.455833974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:26:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:26:57.452604701 +0000 UTC m=+940.005064826" watchObservedRunningTime="2026-11-04 01:26:57.455833974 +0000 UTC m=+940.008294101"
Nov 04 01:26:57.562989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:57.557047    5640 patch_prober.go:29] interesting pod/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 04 01:26:57.562989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:57.557115    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr" podUID="3a3a0f69-18a0-4089-a37e-2034c873bde6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 04 01:26:58.090558 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:58.090517    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:26:58.340413 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:58.340376    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp" event={"ID":"b471b303-951d-4e37-8046-5b6587e12e93","Type":"ContainerStarted","Data":"d6cb2412a37196cd4b43f6de06bc61beb846081a53af5ebd8d78ff6706adcf6e"}
Nov 04 01:26:58.552450 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:58.552420    5640 patch_prober.go:29] interesting pod/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 04 01:26:58.552734 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:58.552704    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr" podUID="3a3a0f69-18a0-4089-a37e-2034c873bde6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 04 01:26:59.562992 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:59.549056    5640 patch_prober.go:29] interesting pod/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 04 01:26:59.562992 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:26:59.549114    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr" podUID="3a3a0f69-18a0-4089-a37e-2034c873bde6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 04 01:27:00.565992 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:00.565062    5640 patch_prober.go:29] interesting pod/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Nov 04 01:27:00.565992 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:00.565123    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr" podUID="3a3a0f69-18a0-4089-a37e-2034c873bde6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Nov 04 01:27:01.550650 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:01.550623    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:27:01.551615 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:01.551594    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:27:04.126484 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:04.126453    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"]
Nov 04 01:27:04.129183 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:04.129167    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"
Nov 04 01:27:04.130626 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:04.130610    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t226s\" (UniqueName: \"kubernetes.io/projected/96ccdcef-08b4-4c72-b50b-be349fadb0b0-kube-api-access-t226s\") pod \"maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc\" (UID: \"96ccdcef-08b4-4c72-b50b-be349fadb0b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"
Nov 04 01:27:04.130682 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:04.130667    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96ccdcef-08b4-4c72-b50b-be349fadb0b0-maas-api-tls\") pod \"maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc\" (UID: \"96ccdcef-08b4-4c72-b50b-be349fadb0b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"
Nov 04 01:27:04.130759 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:04.130747    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96ccdcef-08b4-4c72-b50b-be349fadb0b0-metrics-certs\") pod \"maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc\" (UID: \"96ccdcef-08b4-4c72-b50b-be349fadb0b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"
Nov 04 01:27:04.130794 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:04.130780    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96ccdcef-08b4-4c72-b50b-be349fadb0b0-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc\" (UID: \"96ccdcef-08b4-4c72-b50b-be349fadb0b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"
Nov 04 01:27:04.183238 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:04.183178    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-1baf54-serving-cert\""
Nov 04 01:27:04.185192 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:04.185170    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"]
Nov 04 01:27:04.231562 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:04.231540    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96ccdcef-08b4-4c72-b50b-be349fadb0b0-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc\" (UID: \"96ccdcef-08b4-4c72-b50b-be349fadb0b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"
Nov 04 01:27:04.231654 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:04.231635    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t226s\" (UniqueName: \"kubernetes.io/projected/96ccdcef-08b4-4c72-b50b-be349fadb0b0-kube-api-access-t226s\") pod \"maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc\" (UID: \"96ccdcef-08b4-4c72-b50b-be349fadb0b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"
Nov 04 01:27:04.231716 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:04.231682    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96ccdcef-08b4-4c72-b50b-be349fadb0b0-maas-api-tls\") pod \"maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc\" (UID: \"96ccdcef-08b4-4c72-b50b-be349fadb0b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"
Nov 04 01:27:04.231772 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:04.231737    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96ccdcef-08b4-4c72-b50b-be349fadb0b0-metrics-certs\") pod \"maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc\" (UID: \"96ccdcef-08b4-4c72-b50b-be349fadb0b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"
Nov 04 01:27:04.231860 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:27:04.231839    5640 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-serving-cert: secret "maas-api-e2e-worker-w1-1baf54-serving-cert" not found
Nov 04 01:27:04.231916 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:27:04.231910    5640 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96ccdcef-08b4-4c72-b50b-be349fadb0b0-maas-api-tls podName:96ccdcef-08b4-4c72-b50b-be349fadb0b0 nodeName:}" failed. No retries permitted until 2026-11-04 01:27:04.731895534 +0000 UTC m=+947.284355639 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/96ccdcef-08b4-4c72-b50b-be349fadb0b0-maas-api-tls") pod "maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc" (UID: "96ccdcef-08b4-4c72-b50b-be349fadb0b0") : secret "maas-api-e2e-worker-w1-1baf54-serving-cert" not found
Nov 04 01:27:04.232222 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:04.232205    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96ccdcef-08b4-4c72-b50b-be349fadb0b0-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc\" (UID: \"96ccdcef-08b4-4c72-b50b-be349fadb0b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"
Nov 04 01:27:04.234030 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:04.234015    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96ccdcef-08b4-4c72-b50b-be349fadb0b0-metrics-certs\") pod \"maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc\" (UID: \"96ccdcef-08b4-4c72-b50b-be349fadb0b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"
Nov 04 01:27:04.294462 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:04.294434    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t226s\" (UniqueName: \"kubernetes.io/projected/96ccdcef-08b4-4c72-b50b-be349fadb0b0-kube-api-access-t226s\") pod \"maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc\" (UID: \"96ccdcef-08b4-4c72-b50b-be349fadb0b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"
Nov 04 01:27:04.736204 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:04.736173    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96ccdcef-08b4-4c72-b50b-be349fadb0b0-maas-api-tls\") pod \"maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc\" (UID: \"96ccdcef-08b4-4c72-b50b-be349fadb0b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"
Nov 04 01:27:04.738462 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:04.738441    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96ccdcef-08b4-4c72-b50b-be349fadb0b0-maas-api-tls\") pod \"maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc\" (UID: \"96ccdcef-08b4-4c72-b50b-be349fadb0b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"
Nov 04 01:27:04.741374 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:04.741353    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"
Nov 04 01:27:05.114927 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:05.114900    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"]
Nov 04 01:27:05.115944 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:27:05.115924    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96ccdcef_08b4_4c72_b50b_be349fadb0b0.slice/crio-a2385a12add0db9033284df8d7b225639501bc3bd0639ece72c1c69a2e7f9015 WatchSource:0}: Error finding container a2385a12add0db9033284df8d7b225639501bc3bd0639ece72c1c69a2e7f9015: Status 404 returned error can't find the container with id a2385a12add0db9033284df8d7b225639501bc3bd0639ece72c1c69a2e7f9015
Nov 04 01:27:05.393725 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:05.393663    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc" event={"ID":"96ccdcef-08b4-4c72-b50b-be349fadb0b0","Type":"ContainerStarted","Data":"a2385a12add0db9033284df8d7b225639501bc3bd0639ece72c1c69a2e7f9015"}
Nov 04 01:27:06.400197 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:06.400117    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc" event={"ID":"96ccdcef-08b4-4c72-b50b-be349fadb0b0","Type":"ContainerStarted","Data":"b1c9e18e79a867c0c55ceb7e667cdd2be444ae5e0d111a6065a46edc938e2ac9"}
Nov 04 01:27:06.400538 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:06.400200    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"
Nov 04 01:27:06.522210 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:06.522159    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc" podStartSLOduration=1.577303722 podStartE2EDuration="2.522143472s" totalImagesPullingTime="944.83975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:27:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:27:06.521236098 +0000 UTC m=+949.073696244" watchObservedRunningTime="2026-11-04 01:27:06.522143472 +0000 UTC m=+949.074603611"
Nov 04 01:27:09.357519 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:09.357493    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp"
Nov 04 01:27:11.140854 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:27:11.140820    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:27:12.410406 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:12.410379    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"
Nov 04 01:27:21.175096 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:21.175063    5640 patch_prober.go:29] interesting pod/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 01:27:21.175462 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:21.175113    5640 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978" podUID="e678048d-06f8-4101-85e2-b0c5d125238a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 01:27:23.505329 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:23.505293    5640 generic.go:356] "Generic (PLEG): container finished" podID="e678048d-06f8-4101-85e2-b0c5d125238a" containerID="3357eb8596482ff47260ceedd79ebe50ad3b9ab7cd287693d454a1f201ebb234" exitCode=0
Nov 04 01:27:23.505841 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:23.505346    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978" event={"ID":"e678048d-06f8-4101-85e2-b0c5d125238a","Type":"ContainerDied","Data":"3357eb8596482ff47260ceedd79ebe50ad3b9ab7cd287693d454a1f201ebb234"}
Nov 04 01:27:23.505841 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:23.505800    5640 scope.go:122] "RemoveContainer" containerID="3357eb8596482ff47260ceedd79ebe50ad3b9ab7cd287693d454a1f201ebb234"
Nov 04 01:27:23.507080 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:23.507048    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:27:23.507163 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:23.507119    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:27:23.507163 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:23.507153    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:27:24.512294 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:24.512264    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978" event={"ID":"e678048d-06f8-4101-85e2-b0c5d125238a","Type":"ContainerStarted","Data":"8bec9603521caa39826b22695bdf1c0aae167d57716102432b17a9a9a43ac9e9"}
Nov 04 01:27:24.712550 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:24.712517    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:27:24.712714 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:24.712677    5640 patch_prober.go:29] interesting pod/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Nov 04 01:27:24.712767 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:24.712725    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978" podUID="e678048d-06f8-4101-85e2-b0c5d125238a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Nov 04 01:27:25.712247 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:25.712215    5640 patch_prober.go:29] interesting pod/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Nov 04 01:27:25.712613 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:25.712263    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978" podUID="e678048d-06f8-4101-85e2-b0c5d125238a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Nov 04 01:27:26.712586 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:26.712555    5640 patch_prober.go:29] interesting pod/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Nov 04 01:27:26.712948 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:26.712601    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978" podUID="e678048d-06f8-4101-85e2-b0c5d125238a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Nov 04 01:27:27.713005 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:27.712950    5640 patch_prober.go:29] interesting pod/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Nov 04 01:27:27.713397 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:27.713022    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978" podUID="e678048d-06f8-4101-85e2-b0c5d125238a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Nov 04 01:27:28.712772 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:28.712739    5640 patch_prober.go:29] interesting pod/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Nov 04 01:27:28.712951 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:28.712788    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978" podUID="e678048d-06f8-4101-85e2-b0c5d125238a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Nov 04 01:27:29.716271 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:29.716245    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:27:29.716658 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:29.716626    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:27:29.717245 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:29.717227    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:27:37.229673 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.229634    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"]
Nov 04 01:27:37.233412 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.233389    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:27:37.281563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.281530    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-dshm\") pod \"premium-w3-9f7183-kserve-57f4d8db8f-lwkbm\" (UID: \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\") " pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:27:37.281705 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.281580    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-model-cache\") pod \"premium-w3-9f7183-kserve-57f4d8db8f-lwkbm\" (UID: \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\") " pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:27:37.281705 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.281656    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f451fd0-3f5b-464e-8e0a-c308fb4be072-tls-certs\") pod \"premium-w3-9f7183-kserve-57f4d8db8f-lwkbm\" (UID: \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\") " pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:27:37.281816 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.281708    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-tmp-dir\") pod \"premium-w3-9f7183-kserve-57f4d8db8f-lwkbm\" (UID: \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\") " pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:27:37.281816 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.281790    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-home\") pod \"premium-w3-9f7183-kserve-57f4d8db8f-lwkbm\" (UID: \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\") " pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:27:37.281923 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.281844    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxf8h\" (UniqueName: \"kubernetes.io/projected/1f451fd0-3f5b-464e-8e0a-c308fb4be072-kube-api-access-xxf8h\") pod \"premium-w3-9f7183-kserve-57f4d8db8f-lwkbm\" (UID: \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\") " pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:27:37.288569 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.288544    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"]
Nov 04 01:27:37.337131 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.337111    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-9f7183\"/\"openshift-service-ca.crt\""
Nov 04 01:27:37.337229 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.337213    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-9f7183\"/\"premium-w3-9f7183-kserve-self-signed-certs\""
Nov 04 01:27:37.337283 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.337233    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-9f7183\"/\"default-dockercfg-5lbgl\""
Nov 04 01:27:37.340071 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.340059    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-9f7183\"/\"kube-root-ca.crt\""
Nov 04 01:27:37.382458 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.382435    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-tmp-dir\") pod \"premium-w3-9f7183-kserve-57f4d8db8f-lwkbm\" (UID: \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\") " pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:27:37.382546 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.382466    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-home\") pod \"premium-w3-9f7183-kserve-57f4d8db8f-lwkbm\" (UID: \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\") " pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:27:37.382546 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.382512    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxf8h\" (UniqueName: \"kubernetes.io/projected/1f451fd0-3f5b-464e-8e0a-c308fb4be072-kube-api-access-xxf8h\") pod \"premium-w3-9f7183-kserve-57f4d8db8f-lwkbm\" (UID: \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\") " pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:27:37.382630 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.382565    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-dshm\") pod \"premium-w3-9f7183-kserve-57f4d8db8f-lwkbm\" (UID: \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\") " pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:27:37.382630 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.382581    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-model-cache\") pod \"premium-w3-9f7183-kserve-57f4d8db8f-lwkbm\" (UID: \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\") " pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:27:37.382786 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.382763    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f451fd0-3f5b-464e-8e0a-c308fb4be072-tls-certs\") pod \"premium-w3-9f7183-kserve-57f4d8db8f-lwkbm\" (UID: \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\") " pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:27:37.382888 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.382866    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-tmp-dir\") pod \"premium-w3-9f7183-kserve-57f4d8db8f-lwkbm\" (UID: \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\") " pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:27:37.382963 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.382873    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-home\") pod \"premium-w3-9f7183-kserve-57f4d8db8f-lwkbm\" (UID: \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\") " pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:27:37.382963 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.382909    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-model-cache\") pod \"premium-w3-9f7183-kserve-57f4d8db8f-lwkbm\" (UID: \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\") " pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:27:37.384796 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.384775    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-dshm\") pod \"premium-w3-9f7183-kserve-57f4d8db8f-lwkbm\" (UID: \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\") " pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:27:37.385122 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.385102    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f451fd0-3f5b-464e-8e0a-c308fb4be072-tls-certs\") pod \"premium-w3-9f7183-kserve-57f4d8db8f-lwkbm\" (UID: \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\") " pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:27:37.444914 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.444890    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxf8h\" (UniqueName: \"kubernetes.io/projected/1f451fd0-3f5b-464e-8e0a-c308fb4be072-kube-api-access-xxf8h\") pod \"premium-w3-9f7183-kserve-57f4d8db8f-lwkbm\" (UID: \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\") " pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:27:37.544466 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.544445    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:27:37.925047 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:37.925025    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"]
Nov 04 01:27:37.926734 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:27:37.926708    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f451fd0_3f5b_464e_8e0a_c308fb4be072.slice/crio-cac44bc99e86db36581db6063d23fe68276cc64a9e4ffff027564522f2c96be3 WatchSource:0}: Error finding container cac44bc99e86db36581db6063d23fe68276cc64a9e4ffff027564522f2c96be3: Status 404 returned error can't find the container with id cac44bc99e86db36581db6063d23fe68276cc64a9e4ffff027564522f2c96be3
Nov 04 01:27:38.582992 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:38.582940    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm" event={"ID":"1f451fd0-3f5b-464e-8e0a-c308fb4be072","Type":"ContainerStarted","Data":"e2d7eb0e062c5fc81d445ddd7dd2b016faf4f6de4bedf9c5c5cf324b145d4abc"}
Nov 04 01:27:38.583439 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:38.582998    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm" event={"ID":"1f451fd0-3f5b-464e-8e0a-c308fb4be072","Type":"ContainerStarted","Data":"cac44bc99e86db36581db6063d23fe68276cc64a9e4ffff027564522f2c96be3"}
Nov 04 01:27:38.703321 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:38.703272    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm" podStartSLOduration=1.703258497 podStartE2EDuration="1.703258497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:27:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:27:38.701784494 +0000 UTC m=+981.254244621" watchObservedRunningTime="2026-11-04 01:27:38.703258497 +0000 UTC m=+981.255718623"
Nov 04 01:27:39.545326 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:39.545298    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:27:41.140247 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:27:41.140210    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:27:47.545421 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:47.545390    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:27:47.557049 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:47.557027    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:27:47.635856 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:47.635834    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:27:56.939342 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:56.939308    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"]
Nov 04 01:27:56.943085 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:56.943069    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:27:56.996875 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:56.996842    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"]
Nov 04 01:27:57.046535 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.046509    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-a96a99\"/\"default-dockercfg-gkd6n\""
Nov 04 01:27:57.046687 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.046605    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-a96a99\"/\"simulator-w0-a96a99-kserve-self-signed-certs\""
Nov 04 01:27:57.048484 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.048470    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-a96a99\"/\"kube-root-ca.crt\""
Nov 04 01:27:57.048560 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.048546    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-a96a99\"/\"openshift-service-ca.crt\""
Nov 04 01:27:57.057658 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.057636    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-home\") pod \"simulator-w0-a96a99-kserve-67564cf55b-4n6qp\" (UID: \"8bfedc7d-495f-4487-81fb-3ddfc319f084\") " pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:27:57.057736 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.057661    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-dshm\") pod \"simulator-w0-a96a99-kserve-67564cf55b-4n6qp\" (UID: \"8bfedc7d-495f-4487-81fb-3ddfc319f084\") " pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:27:57.057736 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.057687    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-tmp-dir\") pod \"simulator-w0-a96a99-kserve-67564cf55b-4n6qp\" (UID: \"8bfedc7d-495f-4487-81fb-3ddfc319f084\") " pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:27:57.057811 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.057794    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dd7b\" (UniqueName: \"kubernetes.io/projected/8bfedc7d-495f-4487-81fb-3ddfc319f084-kube-api-access-8dd7b\") pod \"simulator-w0-a96a99-kserve-67564cf55b-4n6qp\" (UID: \"8bfedc7d-495f-4487-81fb-3ddfc319f084\") " pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:27:57.057851 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.057822    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-model-cache\") pod \"simulator-w0-a96a99-kserve-67564cf55b-4n6qp\" (UID: \"8bfedc7d-495f-4487-81fb-3ddfc319f084\") " pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:27:57.057885 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.057859    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bfedc7d-495f-4487-81fb-3ddfc319f084-tls-certs\") pod \"simulator-w0-a96a99-kserve-67564cf55b-4n6qp\" (UID: \"8bfedc7d-495f-4487-81fb-3ddfc319f084\") " pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:27:57.159152 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.159114    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-tmp-dir\") pod \"simulator-w0-a96a99-kserve-67564cf55b-4n6qp\" (UID: \"8bfedc7d-495f-4487-81fb-3ddfc319f084\") " pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:27:57.159355 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.159203    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dd7b\" (UniqueName: \"kubernetes.io/projected/8bfedc7d-495f-4487-81fb-3ddfc319f084-kube-api-access-8dd7b\") pod \"simulator-w0-a96a99-kserve-67564cf55b-4n6qp\" (UID: \"8bfedc7d-495f-4487-81fb-3ddfc319f084\") " pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:27:57.159355 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.159238    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-model-cache\") pod \"simulator-w0-a96a99-kserve-67564cf55b-4n6qp\" (UID: \"8bfedc7d-495f-4487-81fb-3ddfc319f084\") " pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:27:57.159355 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.159284    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bfedc7d-495f-4487-81fb-3ddfc319f084-tls-certs\") pod \"simulator-w0-a96a99-kserve-67564cf55b-4n6qp\" (UID: \"8bfedc7d-495f-4487-81fb-3ddfc319f084\") " pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:27:57.159513 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.159392    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-home\") pod \"simulator-w0-a96a99-kserve-67564cf55b-4n6qp\" (UID: \"8bfedc7d-495f-4487-81fb-3ddfc319f084\") " pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:27:57.159513 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.159415    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-dshm\") pod \"simulator-w0-a96a99-kserve-67564cf55b-4n6qp\" (UID: \"8bfedc7d-495f-4487-81fb-3ddfc319f084\") " pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:27:57.159754 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.159731    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-tmp-dir\") pod \"simulator-w0-a96a99-kserve-67564cf55b-4n6qp\" (UID: \"8bfedc7d-495f-4487-81fb-3ddfc319f084\") " pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:27:57.159805 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.159743    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-model-cache\") pod \"simulator-w0-a96a99-kserve-67564cf55b-4n6qp\" (UID: \"8bfedc7d-495f-4487-81fb-3ddfc319f084\") " pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:27:57.160005 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.159950    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-home\") pod \"simulator-w0-a96a99-kserve-67564cf55b-4n6qp\" (UID: \"8bfedc7d-495f-4487-81fb-3ddfc319f084\") " pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:27:57.162243 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.162219    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-dshm\") pod \"simulator-w0-a96a99-kserve-67564cf55b-4n6qp\" (UID: \"8bfedc7d-495f-4487-81fb-3ddfc319f084\") " pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:27:57.162750 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.162725    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bfedc7d-495f-4487-81fb-3ddfc319f084-tls-certs\") pod \"simulator-w0-a96a99-kserve-67564cf55b-4n6qp\" (UID: \"8bfedc7d-495f-4487-81fb-3ddfc319f084\") " pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:27:57.226026 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.225943    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dd7b\" (UniqueName: \"kubernetes.io/projected/8bfedc7d-495f-4487-81fb-3ddfc319f084-kube-api-access-8dd7b\") pod \"simulator-w0-a96a99-kserve-67564cf55b-4n6qp\" (UID: \"8bfedc7d-495f-4487-81fb-3ddfc319f084\") " pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:27:57.256672 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.256610    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:27:57.646100 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.646072    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"]
Nov 04 01:27:57.646627 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:27:57.646603    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8bfedc7d_495f_4487_81fb_3ddfc319f084.slice/crio-2c8419df5bd1f79ab00f43bc79fa4be0f70517d13a424df694fca1fbee92131b WatchSource:0}: Error finding container 2c8419df5bd1f79ab00f43bc79fa4be0f70517d13a424df694fca1fbee92131b: Status 404 returned error can't find the container with id 2c8419df5bd1f79ab00f43bc79fa4be0f70517d13a424df694fca1fbee92131b
Nov 04 01:27:57.680544 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:57.680520    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp" event={"ID":"8bfedc7d-495f-4487-81fb-3ddfc319f084","Type":"ContainerStarted","Data":"2c8419df5bd1f79ab00f43bc79fa4be0f70517d13a424df694fca1fbee92131b"}
Nov 04 01:27:58.686958 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:58.686927    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp" event={"ID":"8bfedc7d-495f-4487-81fb-3ddfc319f084","Type":"ContainerStarted","Data":"2b787072acc544f323e365858288f22c945f847576b1ee8070e955ff0e2835ed"}
Nov 04 01:27:58.807742 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:58.807699    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp" podStartSLOduration=2.807686823 podStartE2EDuration="2.807686823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:27:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:27:58.807135535 +0000 UTC m=+1001.359595662" watchObservedRunningTime="2026-11-04 01:27:58.807686823 +0000 UTC m=+1001.360146948"
Nov 04 01:27:59.257177 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:27:59.257144    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:28:07.257365 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:07.257333    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:28:07.269908 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:07.269883    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:28:07.741796 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:07.741769    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:28:11.140617 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:28:11.140580    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:28:17.026852 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.026817    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"]
Nov 04 01:28:17.030732 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.030717    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:28:17.053469 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.053444    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-dshm\") pod \"simulator-w1-1baf54-kserve-5df6c9c647-qdz2v\" (UID: \"ad652044-a765-43b7-b77d-d929324086de\") " pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:28:17.053586 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.053475    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9mbt\" (UniqueName: \"kubernetes.io/projected/ad652044-a765-43b7-b77d-d929324086de-kube-api-access-h9mbt\") pod \"simulator-w1-1baf54-kserve-5df6c9c647-qdz2v\" (UID: \"ad652044-a765-43b7-b77d-d929324086de\") " pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:28:17.053586 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.053516    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad652044-a765-43b7-b77d-d929324086de-tls-certs\") pod \"simulator-w1-1baf54-kserve-5df6c9c647-qdz2v\" (UID: \"ad652044-a765-43b7-b77d-d929324086de\") " pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:28:17.053586 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.053560    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-model-cache\") pod \"simulator-w1-1baf54-kserve-5df6c9c647-qdz2v\" (UID: \"ad652044-a765-43b7-b77d-d929324086de\") " pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:28:17.053731 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.053706    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-home\") pod \"simulator-w1-1baf54-kserve-5df6c9c647-qdz2v\" (UID: \"ad652044-a765-43b7-b77d-d929324086de\") " pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:28:17.053832 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.053814    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-tmp-dir\") pod \"simulator-w1-1baf54-kserve-5df6c9c647-qdz2v\" (UID: \"ad652044-a765-43b7-b77d-d929324086de\") " pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:28:17.084425 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.084397    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"]
Nov 04 01:28:17.133988 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.133948    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-1baf54\"/\"openshift-service-ca.crt\""
Nov 04 01:28:17.134153 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.133959    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-1baf54\"/\"kube-root-ca.crt\""
Nov 04 01:28:17.136390 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.136367    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-1baf54\"/\"default-dockercfg-4g9z9\""
Nov 04 01:28:17.136445 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.136368    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-1baf54\"/\"simulator-w1-1baf54-kserve-self-signed-certs\""
Nov 04 01:28:17.154495 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.154468    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad652044-a765-43b7-b77d-d929324086de-tls-certs\") pod \"simulator-w1-1baf54-kserve-5df6c9c647-qdz2v\" (UID: \"ad652044-a765-43b7-b77d-d929324086de\") " pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:28:17.154596 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.154499    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-model-cache\") pod \"simulator-w1-1baf54-kserve-5df6c9c647-qdz2v\" (UID: \"ad652044-a765-43b7-b77d-d929324086de\") " pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:28:17.154596 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.154528    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-home\") pod \"simulator-w1-1baf54-kserve-5df6c9c647-qdz2v\" (UID: \"ad652044-a765-43b7-b77d-d929324086de\") " pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:28:17.154735 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.154718    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-tmp-dir\") pod \"simulator-w1-1baf54-kserve-5df6c9c647-qdz2v\" (UID: \"ad652044-a765-43b7-b77d-d929324086de\") " pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:28:17.154842 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.154828    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-dshm\") pod \"simulator-w1-1baf54-kserve-5df6c9c647-qdz2v\" (UID: \"ad652044-a765-43b7-b77d-d929324086de\") " pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:28:17.154899 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.154855    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9mbt\" (UniqueName: \"kubernetes.io/projected/ad652044-a765-43b7-b77d-d929324086de-kube-api-access-h9mbt\") pod \"simulator-w1-1baf54-kserve-5df6c9c647-qdz2v\" (UID: \"ad652044-a765-43b7-b77d-d929324086de\") " pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:28:17.154953 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.154909    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-home\") pod \"simulator-w1-1baf54-kserve-5df6c9c647-qdz2v\" (UID: \"ad652044-a765-43b7-b77d-d929324086de\") " pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:28:17.155037 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.155003    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-model-cache\") pod \"simulator-w1-1baf54-kserve-5df6c9c647-qdz2v\" (UID: \"ad652044-a765-43b7-b77d-d929324086de\") " pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:28:17.155093 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.155071    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-tmp-dir\") pod \"simulator-w1-1baf54-kserve-5df6c9c647-qdz2v\" (UID: \"ad652044-a765-43b7-b77d-d929324086de\") " pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:28:17.156848 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.156825    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-dshm\") pod \"simulator-w1-1baf54-kserve-5df6c9c647-qdz2v\" (UID: \"ad652044-a765-43b7-b77d-d929324086de\") " pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:28:17.156994 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.156962    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad652044-a765-43b7-b77d-d929324086de-tls-certs\") pod \"simulator-w1-1baf54-kserve-5df6c9c647-qdz2v\" (UID: \"ad652044-a765-43b7-b77d-d929324086de\") " pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:28:17.250004 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.249959    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9mbt\" (UniqueName: \"kubernetes.io/projected/ad652044-a765-43b7-b77d-d929324086de-kube-api-access-h9mbt\") pod \"simulator-w1-1baf54-kserve-5df6c9c647-qdz2v\" (UID: \"ad652044-a765-43b7-b77d-d929324086de\") " pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:28:17.343345 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.343274    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:28:17.820952 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:17.820929    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"]
Nov 04 01:28:17.821944 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:28:17.821916    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad652044_a765_43b7_b77d_d929324086de.slice/crio-c0be7fcaf304c3bce9523cd6277a7a1be2d8d9d550f47029fd614fc3b6e94535 WatchSource:0}: Error finding container c0be7fcaf304c3bce9523cd6277a7a1be2d8d9d550f47029fd614fc3b6e94535: Status 404 returned error can't find the container with id c0be7fcaf304c3bce9523cd6277a7a1be2d8d9d550f47029fd614fc3b6e94535
Nov 04 01:28:18.793422 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:18.793381    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v" event={"ID":"ad652044-a765-43b7-b77d-d929324086de","Type":"ContainerStarted","Data":"1e7f5d5047573bccc92c083b13baa372966eb5f422397248d4f0f5f96bcfb16b"}
Nov 04 01:28:18.793422 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:18.793428    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v" event={"ID":"ad652044-a765-43b7-b77d-d929324086de","Type":"ContainerStarted","Data":"c0be7fcaf304c3bce9523cd6277a7a1be2d8d9d550f47029fd614fc3b6e94535"}
Nov 04 01:28:18.913908 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:18.913789    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v" podStartSLOduration=2.913774259 podStartE2EDuration="2.913774259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:28:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:28:18.912836597 +0000 UTC m=+1021.465296719" watchObservedRunningTime="2026-11-04 01:28:18.913774259 +0000 UTC m=+1021.466234385"
Nov 04 01:28:19.344377 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:19.344350    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:28:27.344279 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:27.344236    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:28:27.356400 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:27.356378    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:28:27.845835 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:28:27.845808    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:28:41.143347 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:28:41.143310    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:29:11.140859 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:29:11.140825    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:29:18.546298 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:18.546265    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"]
Nov 04 01:29:18.550034 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:18.550017    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:29:18.603926 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:18.603897    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"]
Nov 04 01:29:18.631109 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:18.631080    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8768bc1c-ab77-4d40-9f39-94787e4e08f0-tls-certs\") pod \"premium-w1-1baf54-kserve-56688d65f4-mvjdz\" (UID: \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\") " pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:29:18.631245 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:18.631120    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-model-cache\") pod \"premium-w1-1baf54-kserve-56688d65f4-mvjdz\" (UID: \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\") " pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:29:18.631245 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:18.631186    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-tmp-dir\") pod \"premium-w1-1baf54-kserve-56688d65f4-mvjdz\" (UID: \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\") " pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:29:18.631341 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:18.631253    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgvc2\" (UniqueName: \"kubernetes.io/projected/8768bc1c-ab77-4d40-9f39-94787e4e08f0-kube-api-access-zgvc2\") pod \"premium-w1-1baf54-kserve-56688d65f4-mvjdz\" (UID: \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\") " pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:29:18.631418 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:18.631401    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-home\") pod \"premium-w1-1baf54-kserve-56688d65f4-mvjdz\" (UID: \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\") " pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:29:18.631469 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:18.631445    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-dshm\") pod \"premium-w1-1baf54-kserve-56688d65f4-mvjdz\" (UID: \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\") " pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:29:18.653252 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:18.653233    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-1baf54\"/\"premium-w1-1baf54-kserve-self-signed-certs\""
Nov 04 01:29:18.732482 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:18.732451    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgvc2\" (UniqueName: \"kubernetes.io/projected/8768bc1c-ab77-4d40-9f39-94787e4e08f0-kube-api-access-zgvc2\") pod \"premium-w1-1baf54-kserve-56688d65f4-mvjdz\" (UID: \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\") " pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:29:18.732662 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:18.732517    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-home\") pod \"premium-w1-1baf54-kserve-56688d65f4-mvjdz\" (UID: \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\") " pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:29:18.732662 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:18.732552    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-dshm\") pod \"premium-w1-1baf54-kserve-56688d65f4-mvjdz\" (UID: \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\") " pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:29:18.732662 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:18.732651    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8768bc1c-ab77-4d40-9f39-94787e4e08f0-tls-certs\") pod \"premium-w1-1baf54-kserve-56688d65f4-mvjdz\" (UID: \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\") " pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:29:18.732816 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:18.732684    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-model-cache\") pod \"premium-w1-1baf54-kserve-56688d65f4-mvjdz\" (UID: \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\") " pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:29:18.732816 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:18.732722    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-tmp-dir\") pod \"premium-w1-1baf54-kserve-56688d65f4-mvjdz\" (UID: \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\") " pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:29:18.733018 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:18.732962    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-home\") pod \"premium-w1-1baf54-kserve-56688d65f4-mvjdz\" (UID: \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\") " pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:29:18.733175 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:18.733153    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-tmp-dir\") pod \"premium-w1-1baf54-kserve-56688d65f4-mvjdz\" (UID: \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\") " pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:29:18.733175 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:18.733167    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-model-cache\") pod \"premium-w1-1baf54-kserve-56688d65f4-mvjdz\" (UID: \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\") " pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:29:18.734929 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:18.734900    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-dshm\") pod \"premium-w1-1baf54-kserve-56688d65f4-mvjdz\" (UID: \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\") " pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:29:18.735310 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:18.735291    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8768bc1c-ab77-4d40-9f39-94787e4e08f0-tls-certs\") pod \"premium-w1-1baf54-kserve-56688d65f4-mvjdz\" (UID: \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\") " pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:29:18.795016 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:18.794990    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgvc2\" (UniqueName: \"kubernetes.io/projected/8768bc1c-ab77-4d40-9f39-94787e4e08f0-kube-api-access-zgvc2\") pod \"premium-w1-1baf54-kserve-56688d65f4-mvjdz\" (UID: \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\") " pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:29:18.861312 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:18.861242    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:29:19.240313 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:19.240289    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"]
Nov 04 01:29:19.241468 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:29:19.241440    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8768bc1c_ab77_4d40_9f39_94787e4e08f0.slice/crio-aceb68e3172f0935aeac6659be8f6349708bd9944459b564fbd8dfdc1bbb111e WatchSource:0}: Error finding container aceb68e3172f0935aeac6659be8f6349708bd9944459b564fbd8dfdc1bbb111e: Status 404 returned error can't find the container with id aceb68e3172f0935aeac6659be8f6349708bd9944459b564fbd8dfdc1bbb111e
Nov 04 01:29:20.105389 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:20.105353    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz" event={"ID":"8768bc1c-ab77-4d40-9f39-94787e4e08f0","Type":"ContainerStarted","Data":"31b1fe853c72f3ac01a6c32e01acb95e76868ea0850ae7ff0dae62b0a10a0e61"}
Nov 04 01:29:20.105773 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:20.105398    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz" event={"ID":"8768bc1c-ab77-4d40-9f39-94787e4e08f0","Type":"ContainerStarted","Data":"aceb68e3172f0935aeac6659be8f6349708bd9944459b564fbd8dfdc1bbb111e"}
Nov 04 01:29:20.253837 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:20.253788    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz" podStartSLOduration=2.25377341 podStartE2EDuration="2.25377341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:29:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:29:20.253132238 +0000 UTC m=+1082.805592364" watchObservedRunningTime="2026-11-04 01:29:20.25377341 +0000 UTC m=+1082.806233536"
Nov 04 01:29:20.861774 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:20.861746    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:29:28.862262 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:28.862187    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:29:28.873914 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:28.873892    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:29:29.160258 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:29.160184    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:29:41.141031 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:29:41.140998    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:29:51.682143 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.682111    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"]
Nov 04 01:29:51.685865 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.685849    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.740428 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.740400    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-b2eadb-openshift-default-dockercfg-b9qd7\""
Nov 04 01:29:51.752544 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.752519    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-credential-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.752660 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.752572    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-envoy\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.752660 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.752593    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-podinfo\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.752740 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.752702    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-workload-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.752780 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.752744    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbw4n\" (UniqueName: \"kubernetes.io/projected/1d85cafc-0f17-463f-a993-48d4a9c918c4-kube-api-access-mbw4n\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.752780 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.752761    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-data\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.752853 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.752819    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-workload-certs\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.752887 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.752862    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d85cafc-0f17-463f-a993-48d4a9c918c4-istiod-ca-cert\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.752933 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.752887    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-token\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.793993 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.793954    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"]
Nov 04 01:29:51.854340 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.854311    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-credential-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.854463 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.854378    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-envoy\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.854463 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.854409    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-podinfo\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.854463 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.854442    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-workload-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.854626 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.854487    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbw4n\" (UniqueName: \"kubernetes.io/projected/1d85cafc-0f17-463f-a993-48d4a9c918c4-kube-api-access-mbw4n\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.854626 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.854514    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-data\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.854626 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.854580    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-workload-certs\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.854626 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.854612    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d85cafc-0f17-463f-a993-48d4a9c918c4-istiod-ca-cert\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.854841 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.854658    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-token\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.854841 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.854757    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-credential-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.854963 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.854939    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-workload-certs\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.855037 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.854991    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-workload-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.855264 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.855241    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-data\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.855403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.855362    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d85cafc-0f17-463f-a993-48d4a9c918c4-istiod-ca-cert\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.856720 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.856699    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-envoy\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.856938 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.856920    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-podinfo\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.916902 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.916878    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-token\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:51.917115 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:51.917099    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbw4n\" (UniqueName: \"kubernetes.io/projected/1d85cafc-0f17-463f-a993-48d4a9c918c4-kube-api-access-mbw4n\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:52.002461 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:52.002399    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:52.431500 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:52.431475    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"]
Nov 04 01:29:52.432727 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:29:52.432704    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d85cafc_0f17_463f_a993_48d4a9c918c4.slice/crio-6431598bdeec18cacda894fbbdd085eb40fc9501481726bb9511f5cf9e1046d2 WatchSource:0}: Error finding container 6431598bdeec18cacda894fbbdd085eb40fc9501481726bb9511f5cf9e1046d2: Status 404 returned error can't find the container with id 6431598bdeec18cacda894fbbdd085eb40fc9501481726bb9511f5cf9e1046d2
Nov 04 01:29:52.434786 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:52.434756    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:29:52.434862 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:52.434816    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:29:52.434862 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:52.434846    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:29:53.276492 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:53.276457    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc" event={"ID":"1d85cafc-0f17-463f-a993-48d4a9c918c4","Type":"ContainerStarted","Data":"fdcd7a9ae95936988138c0b09511070f734fe12b545fdc4e06069038b9772ec5"}
Nov 04 01:29:53.276914 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:53.276518    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc" event={"ID":"1d85cafc-0f17-463f-a993-48d4a9c918c4","Type":"ContainerStarted","Data":"6431598bdeec18cacda894fbbdd085eb40fc9501481726bb9511f5cf9e1046d2"}
Nov 04 01:29:53.486760 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:53.486705    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc" podStartSLOduration=2.486689866 podStartE2EDuration="2.486689866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:29:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:29:53.452642464 +0000 UTC m=+1116.005102591" watchObservedRunningTime="2026-11-04 01:29:53.486689866 +0000 UTC m=+1116.039149992"
Nov 04 01:29:54.003470 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:54.003437    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:54.004521 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:54.004498    5640 patch_prober.go:29] interesting pod/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Nov 04 01:29:54.004634 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:54.004541    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc" podUID="1d85cafc-0f17-463f-a993-48d4a9c918c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Nov 04 01:29:55.003496 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:55.003465    5640 patch_prober.go:29] interesting pod/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Nov 04 01:29:55.004001 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:55.003519    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc" podUID="1d85cafc-0f17-463f-a993-48d4a9c918c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Nov 04 01:29:56.003074 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:56.003045    5640 patch_prober.go:29] interesting pod/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Nov 04 01:29:56.003245 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:56.003094    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc" podUID="1d85cafc-0f17-463f-a993-48d4a9c918c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Nov 04 01:29:57.003487 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:57.003455    5640 patch_prober.go:29] interesting pod/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Nov 04 01:29:57.003862 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:57.003514    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc" podUID="1d85cafc-0f17-463f-a993-48d4a9c918c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Nov 04 01:29:58.002856 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:58.002826    5640 patch_prober.go:29] interesting pod/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Nov 04 01:29:58.003035 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:58.002937    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc" podUID="1d85cafc-0f17-463f-a993-48d4a9c918c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Nov 04 01:29:59.006500 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:59.006473    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:59.006899 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:59.006778    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:29:59.007342 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:29:59.007326    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:30:11.140707 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:30:11.140673    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:30:41.143155 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:30:41.143117    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:31:11.140689 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:31:11.140606    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:31:28.193271 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.193237    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"]
Nov 04 01:31:28.196696 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.196674    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:31:28.251775 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.251738    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-b2eadb\"/\"default-dockercfg-hzvpz\""
Nov 04 01:31:28.302892 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.302859    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-b2eadb\"/\"kube-root-ca.crt\""
Nov 04 01:31:28.303252 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.303226    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-b2eadb\"/\"distinct-w4-b2eadb-kserve-self-signed-certs\""
Nov 04 01:31:28.303393 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.303253    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-b2eadb\"/\"openshift-service-ca.crt\""
Nov 04 01:31:28.305011 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.304990    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"]
Nov 04 01:31:28.308889 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.308866    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-tmp-dir\") pod \"distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm\" (UID: \"50a257e9-8e2e-456f-b2be-fa577aed740c\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:31:28.308991 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.308902    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50a257e9-8e2e-456f-b2be-fa577aed740c-tls-certs\") pod \"distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm\" (UID: \"50a257e9-8e2e-456f-b2be-fa577aed740c\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:31:28.308991 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.308923    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-dshm\") pod \"distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm\" (UID: \"50a257e9-8e2e-456f-b2be-fa577aed740c\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:31:28.309097 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.309048    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8frt\" (UniqueName: \"kubernetes.io/projected/50a257e9-8e2e-456f-b2be-fa577aed740c-kube-api-access-v8frt\") pod \"distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm\" (UID: \"50a257e9-8e2e-456f-b2be-fa577aed740c\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:31:28.309235 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.309215    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-model-cache\") pod \"distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm\" (UID: \"50a257e9-8e2e-456f-b2be-fa577aed740c\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:31:28.309296 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.309253    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-home\") pod \"distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm\" (UID: \"50a257e9-8e2e-456f-b2be-fa577aed740c\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:31:28.410354 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.410317    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50a257e9-8e2e-456f-b2be-fa577aed740c-tls-certs\") pod \"distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm\" (UID: \"50a257e9-8e2e-456f-b2be-fa577aed740c\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:31:28.410521 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.410362    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-dshm\") pod \"distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm\" (UID: \"50a257e9-8e2e-456f-b2be-fa577aed740c\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:31:28.410521 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.410410    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8frt\" (UniqueName: \"kubernetes.io/projected/50a257e9-8e2e-456f-b2be-fa577aed740c-kube-api-access-v8frt\") pod \"distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm\" (UID: \"50a257e9-8e2e-456f-b2be-fa577aed740c\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:31:28.410594 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.410581    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-model-cache\") pod \"distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm\" (UID: \"50a257e9-8e2e-456f-b2be-fa577aed740c\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:31:28.410634 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.410622    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-home\") pod \"distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm\" (UID: \"50a257e9-8e2e-456f-b2be-fa577aed740c\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:31:28.410673 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.410646    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-tmp-dir\") pod \"distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm\" (UID: \"50a257e9-8e2e-456f-b2be-fa577aed740c\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:31:28.411024 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.411000    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-model-cache\") pod \"distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm\" (UID: \"50a257e9-8e2e-456f-b2be-fa577aed740c\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:31:28.411024 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.411016    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-home\") pod \"distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm\" (UID: \"50a257e9-8e2e-456f-b2be-fa577aed740c\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:31:28.411195 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.411049    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-tmp-dir\") pod \"distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm\" (UID: \"50a257e9-8e2e-456f-b2be-fa577aed740c\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:31:28.412670 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.412644    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-dshm\") pod \"distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm\" (UID: \"50a257e9-8e2e-456f-b2be-fa577aed740c\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:31:28.413067 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.413050    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50a257e9-8e2e-456f-b2be-fa577aed740c-tls-certs\") pod \"distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm\" (UID: \"50a257e9-8e2e-456f-b2be-fa577aed740c\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:31:28.474073 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.473986    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8frt\" (UniqueName: \"kubernetes.io/projected/50a257e9-8e2e-456f-b2be-fa577aed740c-kube-api-access-v8frt\") pod \"distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm\" (UID: \"50a257e9-8e2e-456f-b2be-fa577aed740c\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:31:28.509229 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.509194    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:31:28.887955 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:28.887927    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"]
Nov 04 01:31:28.889120 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:31:28.889092    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50a257e9_8e2e_456f_b2be_fa577aed740c.slice/crio-4ae83d111e1d5566b2c687772ceae8e8566fab0a29dcb69159097950cf4ae856 WatchSource:0}: Error finding container 4ae83d111e1d5566b2c687772ceae8e8566fab0a29dcb69159097950cf4ae856: Status 404 returned error can't find the container with id 4ae83d111e1d5566b2c687772ceae8e8566fab0a29dcb69159097950cf4ae856
Nov 04 01:31:29.787773 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:29.787734    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm" event={"ID":"50a257e9-8e2e-456f-b2be-fa577aed740c","Type":"ContainerStarted","Data":"dbe1acda5de2f8a235028560934ac96b958e8479758ce02863f47df08e5bbdcb"}
Nov 04 01:31:29.787773 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:29.787782    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm" event={"ID":"50a257e9-8e2e-456f-b2be-fa577aed740c","Type":"ContainerStarted","Data":"4ae83d111e1d5566b2c687772ceae8e8566fab0a29dcb69159097950cf4ae856"}
Nov 04 01:31:29.907979 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:29.907930    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm" podStartSLOduration=1.9079168850000001 podStartE2EDuration="1.907916885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:31:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:31:29.907465182 +0000 UTC m=+1212.459925328" watchObservedRunningTime="2026-11-04 01:31:29.907916885 +0000 UTC m=+1212.460377011"
Nov 04 01:31:30.509700 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:30.509650    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:31:38.509991 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:38.509935    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:31:38.523143 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:38.523108    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:31:38.845742 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:38.845711    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:31:41.141875 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:31:41.141842    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:31:54.862622 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:54.862578    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"]
Nov 04 01:31:54.866533 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:54.866515    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:54.920010 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:54.919953    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e06b964b-13a1-4914-aeb3-068f10ccf996-istiod-ca-cert\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:54.920200 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:54.920020    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-workload-socket\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:54.920200 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:54.920100    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-credential-socket\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:54.920200 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:54.920130    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-token\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:54.920333 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:54.920231    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-envoy\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:54.920333 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:54.920285    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-workload-certs\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:54.920443 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:54.920358    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgz9v\" (UniqueName: \"kubernetes.io/projected/e06b964b-13a1-4914-aeb3-068f10ccf996-kube-api-access-pgz9v\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:54.920443 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:54.920425    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-podinfo\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:54.920538 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:54.920456    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-data\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:54.972524 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:54.972488    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-a96a99-openshift-default-dockercfg-hbmfv\""
Nov 04 01:31:54.974729 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:54.974697    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"]
Nov 04 01:31:55.021510 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.021469    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e06b964b-13a1-4914-aeb3-068f10ccf996-istiod-ca-cert\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:55.021510 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.021511    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-workload-socket\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:55.021723 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.021643    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-credential-socket\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:55.021723 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.021681    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-token\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:55.021799 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.021741    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-envoy\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:55.021799 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.021784    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-workload-certs\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:55.021899 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.021843    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgz9v\" (UniqueName: \"kubernetes.io/projected/e06b964b-13a1-4914-aeb3-068f10ccf996-kube-api-access-pgz9v\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:55.021954 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.021931    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-workload-socket\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:55.022050 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.021936    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-podinfo\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:55.022050 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.022018    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-data\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:55.022158 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.022021    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-credential-socket\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:55.022271 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.022245    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-workload-certs\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:55.022431 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.022406    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-data\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:55.022539 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.022434    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e06b964b-13a1-4914-aeb3-068f10ccf996-istiod-ca-cert\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:55.024140 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.024118    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-envoy\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:55.024453 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.024431    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-podinfo\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:55.085114 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.085080    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-token\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:55.085330 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.085307    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgz9v\" (UniqueName: \"kubernetes.io/projected/e06b964b-13a1-4914-aeb3-068f10ccf996-kube-api-access-pgz9v\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:55.180779 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.180686    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:55.617728 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.617695    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"]
Nov 04 01:31:55.617881 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:31:55.617824    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode06b964b_13a1_4914_aeb3_068f10ccf996.slice/crio-ba84262fff49b5fcf2110350d1e71946e7bd7812e5c3df2cdcb003796fe6b500 WatchSource:0}: Error finding container ba84262fff49b5fcf2110350d1e71946e7bd7812e5c3df2cdcb003796fe6b500: Status 404 returned error can't find the container with id ba84262fff49b5fcf2110350d1e71946e7bd7812e5c3df2cdcb003796fe6b500
Nov 04 01:31:55.620198 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.620164    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:31:55.620280 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.620249    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:31:55.620321 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.620279    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:31:55.929398 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.929306    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr" event={"ID":"e06b964b-13a1-4914-aeb3-068f10ccf996","Type":"ContainerStarted","Data":"1c3c0ed62dc70d457052d76ad85b3461b7383c538b630bcb16ce6318c0419a67"}
Nov 04 01:31:55.929398 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:55.929364    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr" event={"ID":"e06b964b-13a1-4914-aeb3-068f10ccf996","Type":"ContainerStarted","Data":"ba84262fff49b5fcf2110350d1e71946e7bd7812e5c3df2cdcb003796fe6b500"}
Nov 04 01:31:56.056335 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:56.056285    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr" podStartSLOduration=2.05626818 podStartE2EDuration="2.05626818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:31:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:31:56.054193865 +0000 UTC m=+1238.606654012" watchObservedRunningTime="2026-11-04 01:31:56.05626818 +0000 UTC m=+1238.608728308"
Nov 04 01:31:56.181919 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:56.181827    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:31:56.183648 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:56.183623    5640 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 04 01:31:56.183790 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:56.183666    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr" podUID="e06b964b-13a1-4914-aeb3-068f10ccf996" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 04 01:31:57.181228 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:57.181194    5640 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 04 01:31:57.181631 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:57.181248    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr" podUID="e06b964b-13a1-4914-aeb3-068f10ccf996" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 04 01:31:58.181192 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:58.181152    5640 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 04 01:31:58.181391 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:58.181215    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr" podUID="e06b964b-13a1-4914-aeb3-068f10ccf996" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 04 01:31:59.181062 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:59.181029    5640 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 04 01:31:59.181331 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:31:59.181085    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr" podUID="e06b964b-13a1-4914-aeb3-068f10ccf996" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 04 01:32:00.181708 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:00.181672    5640 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 04 01:32:00.182162 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:00.181724    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr" podUID="e06b964b-13a1-4914-aeb3-068f10ccf996" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 04 01:32:01.181495 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:01.181463    5640 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 04 01:32:01.181675 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:01.181513    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr" podUID="e06b964b-13a1-4914-aeb3-068f10ccf996" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 04 01:32:02.181267 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:02.181224    5640 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 04 01:32:02.181667 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:02.181313    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr" podUID="e06b964b-13a1-4914-aeb3-068f10ccf996" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 04 01:32:03.186719 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:03.186688    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:32:03.187182 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:03.186997    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:32:03.187764 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:03.187748    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:32:11.143228 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:32:11.143190    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:32:11.249591 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:11.249552    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"]
Nov 04 01:32:11.249841 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:11.249814    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh" podUID="030db177-0bd3-4c71-a4e6-b80e5782150d" containerName="istio-proxy" containerID="cri-o://7eccba68f5481ca6c5d914862d42b67414d9e13ba459684f357a69ca639131db" gracePeriod=30
Nov 04 01:32:11.429801 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:11.429722    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 01:32:11.429950 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:11.429812    5640 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh" podUID="030db177-0bd3-4c71-a4e6-b80e5782150d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 01:32:16.540755 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.540727    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:32:16.589427 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.589386    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-workload-socket\") pod \"030db177-0bd3-4c71-a4e6-b80e5782150d\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") "
Nov 04 01:32:16.589633 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.589478    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-data\") pod \"030db177-0bd3-4c71-a4e6-b80e5782150d\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") "
Nov 04 01:32:16.589633 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.589521    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-token\" (UniqueName: \"kubernetes.io/projected/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-token\") pod \"030db177-0bd3-4c71-a4e6-b80e5782150d\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") "
Nov 04 01:32:16.589633 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.589588    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-workload-certs\") pod \"030db177-0bd3-4c71-a4e6-b80e5782150d\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") "
Nov 04 01:32:16.589819 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.589683    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-credential-socket\") pod \"030db177-0bd3-4c71-a4e6-b80e5782150d\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") "
Nov 04 01:32:16.589819 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.589727    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-data" pod "030db177-0bd3-4c71-a4e6-b80e5782150d" (UID: "030db177-0bd3-4c71-a4e6-b80e5782150d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:32:16.589819 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.589757    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/030db177-0bd3-4c71-a4e6-b80e5782150d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/030db177-0bd3-4c71-a4e6-b80e5782150d-istiod-ca-cert\") pod \"030db177-0bd3-4c71-a4e6-b80e5782150d\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") "
Nov 04 01:32:16.590018 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.589840    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/030db177-0bd3-4c71-a4e6-b80e5782150d-kube-api-access-dnflk\" (UniqueName: \"kubernetes.io/projected/030db177-0bd3-4c71-a4e6-b80e5782150d-kube-api-access-dnflk\") pod \"030db177-0bd3-4c71-a4e6-b80e5782150d\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") "
Nov 04 01:32:16.590018 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.589878    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-podinfo\") pod \"030db177-0bd3-4c71-a4e6-b80e5782150d\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") "
Nov 04 01:32:16.590018 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.589917    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-envoy\") pod \"030db177-0bd3-4c71-a4e6-b80e5782150d\" (UID: \"030db177-0bd3-4c71-a4e6-b80e5782150d\") "
Nov 04 01:32:16.590018 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.589924    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-workload-certs" pod "030db177-0bd3-4c71-a4e6-b80e5782150d" (UID: "030db177-0bd3-4c71-a4e6-b80e5782150d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:32:16.590018 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.589958    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-credential-socket" pod "030db177-0bd3-4c71-a4e6-b80e5782150d" (UID: "030db177-0bd3-4c71-a4e6-b80e5782150d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:32:16.590565 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.590314    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-workload-socket" pod "030db177-0bd3-4c71-a4e6-b80e5782150d" (UID: "030db177-0bd3-4c71-a4e6-b80e5782150d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:32:16.590565 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.590390    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/030db177-0bd3-4c71-a4e6-b80e5782150d-istiod-ca-cert" pod "030db177-0bd3-4c71-a4e6-b80e5782150d" (UID: "030db177-0bd3-4c71-a4e6-b80e5782150d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:32:16.590757 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.590583    5640 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-credential-socket\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:32:16.590757 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.590628    5640 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/030db177-0bd3-4c71-a4e6-b80e5782150d-istiod-ca-cert\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:32:16.590757 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.590646    5640 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-workload-socket\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:32:16.590757 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.590660    5640 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-data\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:32:16.590757 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.590674    5640 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-workload-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:32:16.592723 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.592684    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-podinfo" pod "030db177-0bd3-4c71-a4e6-b80e5782150d" (UID: "030db177-0bd3-4c71-a4e6-b80e5782150d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 01:32:16.593121 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.593090    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-envoy" pod "030db177-0bd3-4c71-a4e6-b80e5782150d" (UID: "030db177-0bd3-4c71-a4e6-b80e5782150d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:32:16.593121 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.593103    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/030db177-0bd3-4c71-a4e6-b80e5782150d-kube-api-access-dnflk" pod "030db177-0bd3-4c71-a4e6-b80e5782150d" (UID: "030db177-0bd3-4c71-a4e6-b80e5782150d"). InnerVolumeSpecName "kube-api-access-dnflk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:32:16.593553 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.593532    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-token" pod "030db177-0bd3-4c71-a4e6-b80e5782150d" (UID: "030db177-0bd3-4c71-a4e6-b80e5782150d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:32:16.691593 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.691550    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnflk\" (UniqueName: \"kubernetes.io/projected/030db177-0bd3-4c71-a4e6-b80e5782150d-kube-api-access-dnflk\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:32:16.691593 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.691587    5640 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-podinfo\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:32:16.691593 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.691602    5640 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-envoy\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:32:16.691845 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:16.691614    5640 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/030db177-0bd3-4c71-a4e6-b80e5782150d-istio-token\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:32:17.076445 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:17.076413    5640 generic.go:356] "Generic (PLEG): container finished" podID="030db177-0bd3-4c71-a4e6-b80e5782150d" containerID="7eccba68f5481ca6c5d914862d42b67414d9e13ba459684f357a69ca639131db" exitCode=0
Nov 04 01:32:17.076445 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:17.076450    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh" event={"ID":"030db177-0bd3-4c71-a4e6-b80e5782150d","Type":"ContainerDied","Data":"7eccba68f5481ca6c5d914862d42b67414d9e13ba459684f357a69ca639131db"}
Nov 04 01:32:17.076662 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:17.076467    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"
Nov 04 01:32:17.076662 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:17.076487    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh" event={"ID":"030db177-0bd3-4c71-a4e6-b80e5782150d","Type":"ContainerDied","Data":"af087b5f98cad8019f3fef25e4c0b3dc7c7d6115e033896dacc83f17d6f1476f"}
Nov 04 01:32:17.076662 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:17.076510    5640 scope.go:122] "RemoveContainer" containerID="7eccba68f5481ca6c5d914862d42b67414d9e13ba459684f357a69ca639131db"
Nov 04 01:32:17.087472 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:17.087452    5640 scope.go:122] "RemoveContainer" containerID="7eccba68f5481ca6c5d914862d42b67414d9e13ba459684f357a69ca639131db"
Nov 04 01:32:17.087806 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:32:17.087787    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7eccba68f5481ca6c5d914862d42b67414d9e13ba459684f357a69ca639131db\": container with ID starting with 7eccba68f5481ca6c5d914862d42b67414d9e13ba459684f357a69ca639131db not found: ID does not exist" containerID="7eccba68f5481ca6c5d914862d42b67414d9e13ba459684f357a69ca639131db"
Nov 04 01:32:17.087873 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:17.087822    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eccba68f5481ca6c5d914862d42b67414d9e13ba459684f357a69ca639131db"} err="failed to get container status \"7eccba68f5481ca6c5d914862d42b67414d9e13ba459684f357a69ca639131db\": rpc error: code = NotFound desc = could not find container \"7eccba68f5481ca6c5d914862d42b67414d9e13ba459684f357a69ca639131db\": container with ID starting with 7eccba68f5481ca6c5d914862d42b67414d9e13ba459684f357a69ca639131db not found: ID does not exist"
Nov 04 01:32:17.246642 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:17.246607    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"]
Nov 04 01:32:17.298213 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:17.298181    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-jkdvh"]
Nov 04 01:32:17.564777 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:17.564742    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="030db177-0bd3-4c71-a4e6-b80e5782150d" path="/var/lib/kubelet/pods/030db177-0bd3-4c71-a4e6-b80e5782150d/volumes"
Nov 04 01:32:28.054505 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.054431    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"]
Nov 04 01:32:28.056907 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.055003    5640 cpu_manager.go:414] "containerMap: removing container" podUID="030db177-0bd3-4c71-a4e6-b80e5782150d" containerName="istio-proxy"
Nov 04 01:32:28.056907 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.055017    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="030db177-0bd3-4c71-a4e6-b80e5782150d" containerName="istio-proxy"
Nov 04 01:32:28.056907 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.055095    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="030db177-0bd3-4c71-a4e6-b80e5782150d" containerName="istio-proxy"
Nov 04 01:32:28.058063 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.058048    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:32:28.112234 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.112207    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"]
Nov 04 01:32:28.161834 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.161804    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-1baf54\"/\"distinct-2-w1-1baf54-kserve-self-signed-certs\""
Nov 04 01:32:28.210926 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.210893    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-dshm\") pod \"distinct-2-w1-1baf54-kserve-68c989c66-mjwjq\" (UID: \"3042f316-58e3-4939-b9e9-bbf4396fa23d\") " pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:32:28.211111 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.210934    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhr4l\" (UniqueName: \"kubernetes.io/projected/3042f316-58e3-4939-b9e9-bbf4396fa23d-kube-api-access-vhr4l\") pod \"distinct-2-w1-1baf54-kserve-68c989c66-mjwjq\" (UID: \"3042f316-58e3-4939-b9e9-bbf4396fa23d\") " pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:32:28.211111 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.211017    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-home\") pod \"distinct-2-w1-1baf54-kserve-68c989c66-mjwjq\" (UID: \"3042f316-58e3-4939-b9e9-bbf4396fa23d\") " pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:32:28.211111 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.211045    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-tmp-dir\") pod \"distinct-2-w1-1baf54-kserve-68c989c66-mjwjq\" (UID: \"3042f316-58e3-4939-b9e9-bbf4396fa23d\") " pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:32:28.211225 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.211163    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3042f316-58e3-4939-b9e9-bbf4396fa23d-tls-certs\") pod \"distinct-2-w1-1baf54-kserve-68c989c66-mjwjq\" (UID: \"3042f316-58e3-4939-b9e9-bbf4396fa23d\") " pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:32:28.211225 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.211200    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-model-cache\") pod \"distinct-2-w1-1baf54-kserve-68c989c66-mjwjq\" (UID: \"3042f316-58e3-4939-b9e9-bbf4396fa23d\") " pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:32:28.312456 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.312367    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-model-cache\") pod \"distinct-2-w1-1baf54-kserve-68c989c66-mjwjq\" (UID: \"3042f316-58e3-4939-b9e9-bbf4396fa23d\") " pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:32:28.312628 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.312466    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-dshm\") pod \"distinct-2-w1-1baf54-kserve-68c989c66-mjwjq\" (UID: \"3042f316-58e3-4939-b9e9-bbf4396fa23d\") " pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:32:28.312628 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.312492    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhr4l\" (UniqueName: \"kubernetes.io/projected/3042f316-58e3-4939-b9e9-bbf4396fa23d-kube-api-access-vhr4l\") pod \"distinct-2-w1-1baf54-kserve-68c989c66-mjwjq\" (UID: \"3042f316-58e3-4939-b9e9-bbf4396fa23d\") " pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:32:28.312628 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.312513    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-home\") pod \"distinct-2-w1-1baf54-kserve-68c989c66-mjwjq\" (UID: \"3042f316-58e3-4939-b9e9-bbf4396fa23d\") " pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:32:28.312628 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.312537    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-tmp-dir\") pod \"distinct-2-w1-1baf54-kserve-68c989c66-mjwjq\" (UID: \"3042f316-58e3-4939-b9e9-bbf4396fa23d\") " pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:32:28.312628 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.312605    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3042f316-58e3-4939-b9e9-bbf4396fa23d-tls-certs\") pod \"distinct-2-w1-1baf54-kserve-68c989c66-mjwjq\" (UID: \"3042f316-58e3-4939-b9e9-bbf4396fa23d\") " pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:32:28.312927 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.312895    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-model-cache\") pod \"distinct-2-w1-1baf54-kserve-68c989c66-mjwjq\" (UID: \"3042f316-58e3-4939-b9e9-bbf4396fa23d\") " pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:32:28.313011 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.312934    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-home\") pod \"distinct-2-w1-1baf54-kserve-68c989c66-mjwjq\" (UID: \"3042f316-58e3-4939-b9e9-bbf4396fa23d\") " pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:32:28.313060 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.313013    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-tmp-dir\") pod \"distinct-2-w1-1baf54-kserve-68c989c66-mjwjq\" (UID: \"3042f316-58e3-4939-b9e9-bbf4396fa23d\") " pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:32:28.314857 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.314831    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-dshm\") pod \"distinct-2-w1-1baf54-kserve-68c989c66-mjwjq\" (UID: \"3042f316-58e3-4939-b9e9-bbf4396fa23d\") " pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:32:28.315161 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.315142    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3042f316-58e3-4939-b9e9-bbf4396fa23d-tls-certs\") pod \"distinct-2-w1-1baf54-kserve-68c989c66-mjwjq\" (UID: \"3042f316-58e3-4939-b9e9-bbf4396fa23d\") " pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:32:28.377752 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.377724    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhr4l\" (UniqueName: \"kubernetes.io/projected/3042f316-58e3-4939-b9e9-bbf4396fa23d-kube-api-access-vhr4l\") pod \"distinct-2-w1-1baf54-kserve-68c989c66-mjwjq\" (UID: \"3042f316-58e3-4939-b9e9-bbf4396fa23d\") " pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:32:28.669278 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:28.669200    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:32:29.049038 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:29.049013    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"]
Nov 04 01:32:29.050409 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:32:29.050386    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3042f316_58e3_4939_b9e9_bbf4396fa23d.slice/crio-923ef98cd040c888fde0ad7c7d2056a9ece4631e3b4e8000a45e14b091a27d6e WatchSource:0}: Error finding container 923ef98cd040c888fde0ad7c7d2056a9ece4631e3b4e8000a45e14b091a27d6e: Status 404 returned error can't find the container with id 923ef98cd040c888fde0ad7c7d2056a9ece4631e3b4e8000a45e14b091a27d6e
Nov 04 01:32:29.141814 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:29.141780    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq" event={"ID":"3042f316-58e3-4939-b9e9-bbf4396fa23d","Type":"ContainerStarted","Data":"19bd6978a513849686190ec658066906a784ee8efdd7f536dd54243cc2e4d4c7"}
Nov 04 01:32:29.142180 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:29.141833    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq" event={"ID":"3042f316-58e3-4939-b9e9-bbf4396fa23d","Type":"ContainerStarted","Data":"923ef98cd040c888fde0ad7c7d2056a9ece4631e3b4e8000a45e14b091a27d6e"}
Nov 04 01:32:29.264689 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:29.264637    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq" podStartSLOduration=1.264619165 podStartE2EDuration="1.264619165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:32:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:32:29.262623569 +0000 UTC m=+1271.815083697" watchObservedRunningTime="2026-11-04 01:32:29.264619165 +0000 UTC m=+1271.817079291"
Nov 04 01:32:29.669939 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:29.669907    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:32:38.670033 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:38.669997    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:32:38.682766 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:38.682735    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:32:39.213358 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:39.213324    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:32:41.141608 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:32:41.141573    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:32:59.588955 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:59.588922    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst"]
Nov 04 01:32:59.593646 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:59.593622    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst"
Nov 04 01:32:59.648252 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:59.648220    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst"]
Nov 04 01:32:59.696618 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:59.696581    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-extmod-b-cae0ab-dockercfg-npkh7\""
Nov 04 01:32:59.696795 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:59.696633    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-extmod-b-cae0ab\""
Nov 04 01:32:59.723884 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:59.723846    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn5ts\" (UniqueName: \"kubernetes.io/projected/7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8-kube-api-access-zn5ts\") pod \"payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst\" (UID: \"7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst"
Nov 04 01:32:59.724074 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:59.723894    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8-plugins-config-volume\") pod \"payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst\" (UID: \"7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst"
Nov 04 01:32:59.825571 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:59.825536    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn5ts\" (UniqueName: \"kubernetes.io/projected/7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8-kube-api-access-zn5ts\") pod \"payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst\" (UID: \"7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst"
Nov 04 01:32:59.825763 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:59.825580    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8-plugins-config-volume\") pod \"payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst\" (UID: \"7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst"
Nov 04 01:32:59.826318 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:59.826299    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8-plugins-config-volume\") pod \"payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst\" (UID: \"7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst"
Nov 04 01:32:59.888578 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:59.888501    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn5ts\" (UniqueName: \"kubernetes.io/projected/7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8-kube-api-access-zn5ts\") pod \"payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst\" (UID: \"7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst"
Nov 04 01:32:59.911010 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:32:59.910959    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst"
Nov 04 01:33:00.288227 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:00.288203    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst"]
Nov 04 01:33:00.289738 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:33:00.289712    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b4e6fda_1ba7_4724_88ec_8dfa46eb6ae8.slice/crio-4f0be1ca8d077ad989266e45be181887c97fab6b5bcb0d12cb630ec50b38558e WatchSource:0}: Error finding container 4f0be1ca8d077ad989266e45be181887c97fab6b5bcb0d12cb630ec50b38558e: Status 404 returned error can't find the container with id 4f0be1ca8d077ad989266e45be181887c97fab6b5bcb0d12cb630ec50b38558e
Nov 04 01:33:00.314014 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:00.313984    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst" event={"ID":"7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8","Type":"ContainerStarted","Data":"4f0be1ca8d077ad989266e45be181887c97fab6b5bcb0d12cb630ec50b38558e"}
Nov 04 01:33:01.321038 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:01.320999    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst" event={"ID":"7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8","Type":"ContainerStarted","Data":"8165e8b7d40cea6c7741f178bc7d7768f3383602025c079ff90e3a5f776cb7f4"}
Nov 04 01:33:01.321457 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:01.321074    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst"
Nov 04 01:33:01.444447 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:01.444403    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst" podStartSLOduration=2.444388767 podStartE2EDuration="2.444388767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:32:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:33:01.442041722 +0000 UTC m=+1303.994501849" watchObservedRunningTime="2026-11-04 01:33:01.444388767 +0000 UTC m=+1303.996848913"
Nov 04 01:33:05.741618 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:05.741584    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"]
Nov 04 01:33:05.745682 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:05.745661    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:33:05.799833 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:05.799803    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"]
Nov 04 01:33:05.848829 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:05.848799    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-a96a99\"/\"distinct-2-w0-a96a99-kserve-self-signed-certs\""
Nov 04 01:33:05.894588 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:05.894552    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45f98\" (UniqueName: \"kubernetes.io/projected/d61eb43d-3fb7-4791-9c05-2521348481ba-kube-api-access-45f98\") pod \"distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l\" (UID: \"d61eb43d-3fb7-4791-9c05-2521348481ba\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:33:05.894759 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:05.894705    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-dshm\") pod \"distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l\" (UID: \"d61eb43d-3fb7-4791-9c05-2521348481ba\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:33:05.894759 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:05.894747    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d61eb43d-3fb7-4791-9c05-2521348481ba-tls-certs\") pod \"distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l\" (UID: \"d61eb43d-3fb7-4791-9c05-2521348481ba\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:33:05.894855 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:05.894788    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-tmp-dir\") pod \"distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l\" (UID: \"d61eb43d-3fb7-4791-9c05-2521348481ba\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:33:05.894855 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:05.894829    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-home\") pod \"distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l\" (UID: \"d61eb43d-3fb7-4791-9c05-2521348481ba\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:33:05.894945 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:05.894872    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-model-cache\") pod \"distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l\" (UID: \"d61eb43d-3fb7-4791-9c05-2521348481ba\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:33:05.996519 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:05.996419    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-home\") pod \"distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l\" (UID: \"d61eb43d-3fb7-4791-9c05-2521348481ba\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:33:05.996519 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:05.996476    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-model-cache\") pod \"distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l\" (UID: \"d61eb43d-3fb7-4791-9c05-2521348481ba\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:33:05.996767 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:05.996544    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45f98\" (UniqueName: \"kubernetes.io/projected/d61eb43d-3fb7-4791-9c05-2521348481ba-kube-api-access-45f98\") pod \"distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l\" (UID: \"d61eb43d-3fb7-4791-9c05-2521348481ba\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:33:05.996767 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:05.996656    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-dshm\") pod \"distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l\" (UID: \"d61eb43d-3fb7-4791-9c05-2521348481ba\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:33:05.996767 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:05.996686    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d61eb43d-3fb7-4791-9c05-2521348481ba-tls-certs\") pod \"distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l\" (UID: \"d61eb43d-3fb7-4791-9c05-2521348481ba\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:33:05.996767 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:05.996711    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-tmp-dir\") pod \"distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l\" (UID: \"d61eb43d-3fb7-4791-9c05-2521348481ba\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:33:05.997015 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:05.996942    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-home\") pod \"distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l\" (UID: \"d61eb43d-3fb7-4791-9c05-2521348481ba\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:33:05.997070 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:05.997018    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-model-cache\") pod \"distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l\" (UID: \"d61eb43d-3fb7-4791-9c05-2521348481ba\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:33:05.997070 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:05.997056    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-tmp-dir\") pod \"distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l\" (UID: \"d61eb43d-3fb7-4791-9c05-2521348481ba\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:33:05.999179 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:05.999144    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-dshm\") pod \"distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l\" (UID: \"d61eb43d-3fb7-4791-9c05-2521348481ba\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:33:05.999391 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:05.999372    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d61eb43d-3fb7-4791-9c05-2521348481ba-tls-certs\") pod \"distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l\" (UID: \"d61eb43d-3fb7-4791-9c05-2521348481ba\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:33:06.059652 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:06.059623    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45f98\" (UniqueName: \"kubernetes.io/projected/d61eb43d-3fb7-4791-9c05-2521348481ba-kube-api-access-45f98\") pod \"distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l\" (UID: \"d61eb43d-3fb7-4791-9c05-2521348481ba\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:33:06.357319 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:06.357283    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:33:06.736995 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:06.736941    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"]
Nov 04 01:33:06.737999 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:33:06.737948    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd61eb43d_3fb7_4791_9c05_2521348481ba.slice/crio-010e91d0dd9c0480ace9e903e2740c21dab6845584a801bdbb62cd3c254c017c WatchSource:0}: Error finding container 010e91d0dd9c0480ace9e903e2740c21dab6845584a801bdbb62cd3c254c017c: Status 404 returned error can't find the container with id 010e91d0dd9c0480ace9e903e2740c21dab6845584a801bdbb62cd3c254c017c
Nov 04 01:33:07.360927 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:07.360890    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l" event={"ID":"d61eb43d-3fb7-4791-9c05-2521348481ba","Type":"ContainerStarted","Data":"4f3548050f5e2b5e063c8470079de70ff98507ceb68bb822a002e109f967acb7"}
Nov 04 01:33:07.360927 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:07.360932    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l" event={"ID":"d61eb43d-3fb7-4791-9c05-2521348481ba","Type":"ContainerStarted","Data":"010e91d0dd9c0480ace9e903e2740c21dab6845584a801bdbb62cd3c254c017c"}
Nov 04 01:33:07.481445 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:07.481390    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l" podStartSLOduration=2.481375785 podStartE2EDuration="2.481375785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:33:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:33:07.48025585 +0000 UTC m=+1310.032716002" watchObservedRunningTime="2026-11-04 01:33:07.481375785 +0000 UTC m=+1310.033835915"
Nov 04 01:33:08.357412 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:08.357373    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:33:11.143729 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:33:11.143693    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:33:12.329256 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:12.329221    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst"
Nov 04 01:33:12.892097 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:12.892064    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"]
Nov 04 01:33:12.896175 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:12.896153    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:33:12.951744 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:12.951709    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"]
Nov 04 01:33:13.001053 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:13.001026    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-b2eadb\"/\"distinct-2-w4-b2eadb-kserve-self-signed-certs\""
Nov 04 01:33:13.071449 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:13.071409    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-tmp-dir\") pod \"distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6\" (UID: \"55853f41-4398-4769-a849-857d56ddc2fc\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:33:13.071627 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:13.071459    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55853f41-4398-4769-a849-857d56ddc2fc-tls-certs\") pod \"distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6\" (UID: \"55853f41-4398-4769-a849-857d56ddc2fc\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:33:13.071627 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:13.071486    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c447\" (UniqueName: \"kubernetes.io/projected/55853f41-4398-4769-a849-857d56ddc2fc-kube-api-access-8c447\") pod \"distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6\" (UID: \"55853f41-4398-4769-a849-857d56ddc2fc\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:33:13.071756 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:13.071731    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-home\") pod \"distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6\" (UID: \"55853f41-4398-4769-a849-857d56ddc2fc\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:33:13.071900 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:13.071883    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-model-cache\") pod \"distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6\" (UID: \"55853f41-4398-4769-a849-857d56ddc2fc\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:33:13.071936 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:13.071921    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-dshm\") pod \"distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6\" (UID: \"55853f41-4398-4769-a849-857d56ddc2fc\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:33:13.173133 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:13.173046    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55853f41-4398-4769-a849-857d56ddc2fc-tls-certs\") pod \"distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6\" (UID: \"55853f41-4398-4769-a849-857d56ddc2fc\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:33:13.173133 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:13.173084    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c447\" (UniqueName: \"kubernetes.io/projected/55853f41-4398-4769-a849-857d56ddc2fc-kube-api-access-8c447\") pod \"distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6\" (UID: \"55853f41-4398-4769-a849-857d56ddc2fc\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:33:13.173329 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:13.173185    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-home\") pod \"distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6\" (UID: \"55853f41-4398-4769-a849-857d56ddc2fc\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:33:13.173329 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:13.173296    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-model-cache\") pod \"distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6\" (UID: \"55853f41-4398-4769-a849-857d56ddc2fc\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:33:13.173405 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:13.173332    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-dshm\") pod \"distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6\" (UID: \"55853f41-4398-4769-a849-857d56ddc2fc\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:33:13.173482 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:13.173447    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-tmp-dir\") pod \"distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6\" (UID: \"55853f41-4398-4769-a849-857d56ddc2fc\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:33:13.173675 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:13.173652    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-home\") pod \"distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6\" (UID: \"55853f41-4398-4769-a849-857d56ddc2fc\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:33:13.173738 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:13.173695    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-model-cache\") pod \"distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6\" (UID: \"55853f41-4398-4769-a849-857d56ddc2fc\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:33:13.173870 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:13.173845    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-tmp-dir\") pod \"distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6\" (UID: \"55853f41-4398-4769-a849-857d56ddc2fc\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:33:13.175529 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:13.175510    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-dshm\") pod \"distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6\" (UID: \"55853f41-4398-4769-a849-857d56ddc2fc\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:33:13.176091 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:13.176071    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55853f41-4398-4769-a849-857d56ddc2fc-tls-certs\") pod \"distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6\" (UID: \"55853f41-4398-4769-a849-857d56ddc2fc\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:33:13.236289 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:13.236257    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c447\" (UniqueName: \"kubernetes.io/projected/55853f41-4398-4769-a849-857d56ddc2fc-kube-api-access-8c447\") pod \"distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6\" (UID: \"55853f41-4398-4769-a849-857d56ddc2fc\") " pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:33:13.508796 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:13.508713    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:33:13.894167 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:13.893990    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"]
Nov 04 01:33:13.897003 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:33:13.896944    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55853f41_4398_4769_a849_857d56ddc2fc.slice/crio-b0f24361b9633a6856e0fc69c831013f1173e073d26b1230d19a5c833dbc5c1d WatchSource:0}: Error finding container b0f24361b9633a6856e0fc69c831013f1173e073d26b1230d19a5c833dbc5c1d: Status 404 returned error can't find the container with id b0f24361b9633a6856e0fc69c831013f1173e073d26b1230d19a5c833dbc5c1d
Nov 04 01:33:14.404155 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:14.404123    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6" event={"ID":"55853f41-4398-4769-a849-857d56ddc2fc","Type":"ContainerStarted","Data":"adb292707ba4a84522d5af015caef557eebe265bb1cb1466f4e81e7957695606"}
Nov 04 01:33:14.404332 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:14.404163    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6" event={"ID":"55853f41-4398-4769-a849-857d56ddc2fc","Type":"ContainerStarted","Data":"b0f24361b9633a6856e0fc69c831013f1173e073d26b1230d19a5c833dbc5c1d"}
Nov 04 01:33:14.509498 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:14.509451    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:33:14.526727 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:14.526672    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6" podStartSLOduration=2.526658451 podStartE2EDuration="2.526658451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:33:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:33:14.524511846 +0000 UTC m=+1317.076972010" watchObservedRunningTime="2026-11-04 01:33:14.526658451 +0000 UTC m=+1317.079118578"
Nov 04 01:33:15.517132 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:15.517086    5640 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal" podUID="a8e9fbe3308d7a9dc37557b42c180c40" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": context deadline exceeded"
Nov 04 01:33:16.358245 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:16.358213    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:33:16.370590 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:16.370564    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:33:16.425111 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:16.425080    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:33:23.509540 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:23.509499    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:33:23.522495 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:23.522467    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:33:24.472612 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:24.472579    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:33:41.147025 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:33:41.146982    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:33:48.857281 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:48.857246    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc"]
Nov 04 01:33:48.861419 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:48.861402    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc"
Nov 04 01:33:48.876602 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:48.876576    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34fc7aa2-9592-4115-933f-7dc0ad90b21f-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc\" (UID: \"34fc7aa2-9592-4115-933f-7dc0ad90b21f\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc"
Nov 04 01:33:48.876738 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:48.876725    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2496\" (UniqueName: \"kubernetes.io/projected/34fc7aa2-9592-4115-933f-7dc0ad90b21f-kube-api-access-f2496\") pod \"payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc\" (UID: \"34fc7aa2-9592-4115-933f-7dc0ad90b21f\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc"
Nov 04 01:33:48.915024 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:48.914990    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc"]
Nov 04 01:33:48.917584 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:48.917564    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-extmod-a-b1047d\""
Nov 04 01:33:48.964701 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:48.964665    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-extmod-a-b1047d-dockercfg-w5gml\""
Nov 04 01:33:48.977409 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:48.977377    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2496\" (UniqueName: \"kubernetes.io/projected/34fc7aa2-9592-4115-933f-7dc0ad90b21f-kube-api-access-f2496\") pod \"payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc\" (UID: \"34fc7aa2-9592-4115-933f-7dc0ad90b21f\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc"
Nov 04 01:33:48.977548 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:48.977474    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34fc7aa2-9592-4115-933f-7dc0ad90b21f-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc\" (UID: \"34fc7aa2-9592-4115-933f-7dc0ad90b21f\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc"
Nov 04 01:33:48.978279 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:48.978261    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34fc7aa2-9592-4115-933f-7dc0ad90b21f-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc\" (UID: \"34fc7aa2-9592-4115-933f-7dc0ad90b21f\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc"
Nov 04 01:33:49.024082 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:49.024052    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t"]
Nov 04 01:33:49.028048 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:49.028028    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t"
Nov 04 01:33:49.081945 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:49.081911    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t"]
Nov 04 01:33:49.087648 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:49.087615    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2496\" (UniqueName: \"kubernetes.io/projected/34fc7aa2-9592-4115-933f-7dc0ad90b21f-kube-api-access-f2496\") pod \"payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc\" (UID: \"34fc7aa2-9592-4115-933f-7dc0ad90b21f\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc"
Nov 04 01:33:49.174110 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:49.174024    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc"
Nov 04 01:33:49.184739 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:49.184710    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc425\" (UniqueName: \"kubernetes.io/projected/38461a5c-026f-4c65-b681-a51255299c29-kube-api-access-pc425\") pod \"payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t\" (UID: \"38461a5c-026f-4c65-b681-a51255299c29\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t"
Nov 04 01:33:49.184931 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:49.184912    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38461a5c-026f-4c65-b681-a51255299c29-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t\" (UID: \"38461a5c-026f-4c65-b681-a51255299c29\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t"
Nov 04 01:33:49.285697 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:49.285663    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38461a5c-026f-4c65-b681-a51255299c29-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t\" (UID: \"38461a5c-026f-4c65-b681-a51255299c29\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t"
Nov 04 01:33:49.285855 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:49.285748    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc425\" (UniqueName: \"kubernetes.io/projected/38461a5c-026f-4c65-b681-a51255299c29-kube-api-access-pc425\") pod \"payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t\" (UID: \"38461a5c-026f-4c65-b681-a51255299c29\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t"
Nov 04 01:33:49.286414 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:49.286391    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38461a5c-026f-4c65-b681-a51255299c29-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t\" (UID: \"38461a5c-026f-4c65-b681-a51255299c29\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t"
Nov 04 01:33:49.348784 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:49.348749    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc425\" (UniqueName: \"kubernetes.io/projected/38461a5c-026f-4c65-b681-a51255299c29-kube-api-access-pc425\") pod \"payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t\" (UID: \"38461a5c-026f-4c65-b681-a51255299c29\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t"
Nov 04 01:33:49.550504 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:49.550476    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc"]
Nov 04 01:33:49.551507 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:33:49.551483    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34fc7aa2_9592_4115_933f_7dc0ad90b21f.slice/crio-11b2a2832e431fcf5889d0e9598699a7fcde41801b5c985d0e5879db417eabb1 WatchSource:0}: Error finding container 11b2a2832e431fcf5889d0e9598699a7fcde41801b5c985d0e5879db417eabb1: Status 404 returned error can't find the container with id 11b2a2832e431fcf5889d0e9598699a7fcde41801b5c985d0e5879db417eabb1
Nov 04 01:33:49.614522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:49.614494    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc" event={"ID":"34fc7aa2-9592-4115-933f-7dc0ad90b21f","Type":"ContainerStarted","Data":"11b2a2832e431fcf5889d0e9598699a7fcde41801b5c985d0e5879db417eabb1"}
Nov 04 01:33:49.644861 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:49.644834    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t"
Nov 04 01:33:50.023450 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:50.023422    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t"]
Nov 04 01:33:50.024439 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:33:50.024413    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38461a5c_026f_4c65_b681_a51255299c29.slice/crio-469b74cce6ea1b57ab86c6af969ac7ecc25ca4e90be47628a6a751cad8738a5c WatchSource:0}: Error finding container 469b74cce6ea1b57ab86c6af969ac7ecc25ca4e90be47628a6a751cad8738a5c: Status 404 returned error can't find the container with id 469b74cce6ea1b57ab86c6af969ac7ecc25ca4e90be47628a6a751cad8738a5c
Nov 04 01:33:50.622480 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:50.622440    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t" event={"ID":"38461a5c-026f-4c65-b681-a51255299c29","Type":"ContainerStarted","Data":"8987fc0baf6f5d48fc1854274aeaec510cf3b6abb9cdcb3b986ddf6d450dcd8a"}
Nov 04 01:33:50.622679 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:50.622493    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t" event={"ID":"38461a5c-026f-4c65-b681-a51255299c29","Type":"ContainerStarted","Data":"469b74cce6ea1b57ab86c6af969ac7ecc25ca4e90be47628a6a751cad8738a5c"}
Nov 04 01:33:50.622679 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:50.622530    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t"
Nov 04 01:33:50.624926 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:50.624898    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc" event={"ID":"34fc7aa2-9592-4115-933f-7dc0ad90b21f","Type":"ContainerStarted","Data":"36fc4d88b3a55c3f561176338852e1a49aede53a37018b3b4addb8277432dd25"}
Nov 04 01:33:50.625053 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:50.625005    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc"
Nov 04 01:33:50.745159 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:50.745095    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t" podStartSLOduration=2.745078603 podStartE2EDuration="2.745078603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:33:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:33:50.741824464 +0000 UTC m=+1353.294284614" watchObservedRunningTime="2026-11-04 01:33:50.745078603 +0000 UTC m=+1353.297538730"
Nov 04 01:33:50.861578 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:50.861530    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc" podStartSLOduration=2.8615154670000003 podStartE2EDuration="2.861515467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:33:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:33:50.859756655 +0000 UTC m=+1353.412216797" watchObservedRunningTime="2026-11-04 01:33:50.861515467 +0000 UTC m=+1353.413975631"
Nov 04 01:33:51.996663 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:51.996630    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn"]
Nov 04 01:33:52.000800 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:52.000779    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn"
Nov 04 01:33:52.016721 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:52.016695    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/5c449355-7ac5-44ba-81ae-2863eb46d99b-routing-overlay-volume\") pod \"payload-processing-external-model-7b4675d6f7-sq4wn\" (UID: \"5c449355-7ac5-44ba-81ae-2863eb46d99b\") " pod="models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn"
Nov 04 01:33:52.016880 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:52.016744    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c449355-7ac5-44ba-81ae-2863eb46d99b-plugins-config-volume\") pod \"payload-processing-external-model-7b4675d6f7-sq4wn\" (UID: \"5c449355-7ac5-44ba-81ae-2863eb46d99b\") " pod="models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn"
Nov 04 01:33:52.016978 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:52.016891    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxctl\" (UniqueName: \"kubernetes.io/projected/5c449355-7ac5-44ba-81ae-2863eb46d99b-kube-api-access-dxctl\") pod \"payload-processing-external-model-7b4675d6f7-sq4wn\" (UID: \"5c449355-7ac5-44ba-81ae-2863eb46d99b\") " pod="models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn"
Nov 04 01:33:52.017052 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:52.017034    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/5c449355-7ac5-44ba-81ae-2863eb46d99b-provider-credentials\") pod \"payload-processing-external-model-7b4675d6f7-sq4wn\" (UID: \"5c449355-7ac5-44ba-81ae-2863eb46d99b\") " pod="models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn"
Nov 04 01:33:52.055203 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:52.055172    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn"]
Nov 04 01:33:52.104181 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:52.104141    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"models-as-a-service\"/\"agc-cred-bec17d7cdfd4\""
Nov 04 01:33:52.104181 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:52.104175    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"routing-overlay\""
Nov 04 01:33:52.104375 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:52.104274    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"payload-processing-external-model-plugins\""
Nov 04 01:33:52.104375 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:52.104332    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"openshift-service-ca.crt\""
Nov 04 01:33:52.106445 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:52.106426    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"models-as-a-service\"/\"payload-processing-external-model-dockercfg-qxd95\""
Nov 04 01:33:52.106490 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:52.106444    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"kube-root-ca.crt\""
Nov 04 01:33:52.118135 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:52.118116    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxctl\" (UniqueName: \"kubernetes.io/projected/5c449355-7ac5-44ba-81ae-2863eb46d99b-kube-api-access-dxctl\") pod \"payload-processing-external-model-7b4675d6f7-sq4wn\" (UID: \"5c449355-7ac5-44ba-81ae-2863eb46d99b\") " pod="models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn"
Nov 04 01:33:52.118185 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:52.118170    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/5c449355-7ac5-44ba-81ae-2863eb46d99b-provider-credentials\") pod \"payload-processing-external-model-7b4675d6f7-sq4wn\" (UID: \"5c449355-7ac5-44ba-81ae-2863eb46d99b\") " pod="models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn"
Nov 04 01:33:52.118256 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:52.118242    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/5c449355-7ac5-44ba-81ae-2863eb46d99b-routing-overlay-volume\") pod \"payload-processing-external-model-7b4675d6f7-sq4wn\" (UID: \"5c449355-7ac5-44ba-81ae-2863eb46d99b\") " pod="models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn"
Nov 04 01:33:52.118314 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:52.118299    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c449355-7ac5-44ba-81ae-2863eb46d99b-plugins-config-volume\") pod \"payload-processing-external-model-7b4675d6f7-sq4wn\" (UID: \"5c449355-7ac5-44ba-81ae-2863eb46d99b\") " pod="models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn"
Nov 04 01:33:52.118982 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:52.118952    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/5c449355-7ac5-44ba-81ae-2863eb46d99b-routing-overlay-volume\") pod \"payload-processing-external-model-7b4675d6f7-sq4wn\" (UID: \"5c449355-7ac5-44ba-81ae-2863eb46d99b\") " pod="models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn"
Nov 04 01:33:52.119157 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:52.119136    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c449355-7ac5-44ba-81ae-2863eb46d99b-plugins-config-volume\") pod \"payload-processing-external-model-7b4675d6f7-sq4wn\" (UID: \"5c449355-7ac5-44ba-81ae-2863eb46d99b\") " pod="models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn"
Nov 04 01:33:52.120739 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:52.120719    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/5c449355-7ac5-44ba-81ae-2863eb46d99b-provider-credentials\") pod \"payload-processing-external-model-7b4675d6f7-sq4wn\" (UID: \"5c449355-7ac5-44ba-81ae-2863eb46d99b\") " pod="models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn"
Nov 04 01:33:52.180580 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:52.180550    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxctl\" (UniqueName: \"kubernetes.io/projected/5c449355-7ac5-44ba-81ae-2863eb46d99b-kube-api-access-dxctl\") pod \"payload-processing-external-model-7b4675d6f7-sq4wn\" (UID: \"5c449355-7ac5-44ba-81ae-2863eb46d99b\") " pod="models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn"
Nov 04 01:33:52.314166 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:52.314131    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn"
Nov 04 01:33:52.694599 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:52.694569    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn"]
Nov 04 01:33:52.695533 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:33:52.695505    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c449355_7ac5_44ba_81ae_2863eb46d99b.slice/crio-4586042e9d01a5ec4221fc8bf46bf58d6c0b64e7bba142d3622cbb61abaf6137 WatchSource:0}: Error finding container 4586042e9d01a5ec4221fc8bf46bf58d6c0b64e7bba142d3622cbb61abaf6137: Status 404 returned error can't find the container with id 4586042e9d01a5ec4221fc8bf46bf58d6c0b64e7bba142d3622cbb61abaf6137
Nov 04 01:33:53.643050 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:53.643017    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn" event={"ID":"5c449355-7ac5-44ba-81ae-2863eb46d99b","Type":"ContainerStarted","Data":"04b248de60fedc54ed6d4aa924999b0f885f4ee74a7e02ad6775b5462192fab9"}
Nov 04 01:33:53.643460 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:53.643072    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn" event={"ID":"5c449355-7ac5-44ba-81ae-2863eb46d99b","Type":"ContainerStarted","Data":"4586042e9d01a5ec4221fc8bf46bf58d6c0b64e7bba142d3622cbb61abaf6137"}
Nov 04 01:33:53.643460 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:53.643095    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn"
Nov 04 01:33:53.763886 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:53.763835    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn" podStartSLOduration=2.763822583 podStartE2EDuration="2.763822583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:33:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:33:53.762630504 +0000 UTC m=+1356.315090649" watchObservedRunningTime="2026-11-04 01:33:53.763822583 +0000 UTC m=+1356.316282709"
Nov 04 01:33:55.565402 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.565370    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"]
Nov 04 01:33:55.570020 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.569998    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.643212 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.643180    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"]
Nov 04 01:33:55.658596 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.658555    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg2nz\" (UniqueName: \"kubernetes.io/projected/c22f6e0d-eae6-4456-bb9b-b333349091a6-kube-api-access-lg2nz\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.659139 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.658722    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-token\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.659139 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.658799    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-credential-socket\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.659139 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.658851    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-data\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.659139 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.658888    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-envoy\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.659139 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.658927    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-workload-socket\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.659139 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.658996    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c22f6e0d-eae6-4456-bb9b-b333349091a6-istiod-ca-cert\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.659139 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.659120    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-podinfo\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.659388 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.659271    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-workload-certs\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.760635 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.760602    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-workload-certs\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.760827 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.760652    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg2nz\" (UniqueName: \"kubernetes.io/projected/c22f6e0d-eae6-4456-bb9b-b333349091a6-kube-api-access-lg2nz\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.760827 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.760725    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-token\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.760827 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.760785    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-credential-socket\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.760827 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.760825    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-data\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.761054 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.760859    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-envoy\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.761054 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.760906    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-workload-socket\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.761158 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.761054    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c22f6e0d-eae6-4456-bb9b-b333349091a6-istiod-ca-cert\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.761158 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.761119    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-podinfo\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.761158 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.761120    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-workload-certs\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.761296 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.761218    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-data\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.761296 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.761238    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-workload-socket\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.761296 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.761221    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-credential-socket\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.761727 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.761706    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c22f6e0d-eae6-4456-bb9b-b333349091a6-istiod-ca-cert\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.763202 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.763179    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-envoy\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.763455 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.763437    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-podinfo\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.823425 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.823344    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-token\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.823425 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.823400    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg2nz\" (UniqueName: \"kubernetes.io/projected/c22f6e0d-eae6-4456-bb9b-b333349091a6-kube-api-access-lg2nz\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:55.888824 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:55.888789    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:56.322252 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:56.322224    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"]
Nov 04 01:33:56.322582 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:33:56.322561    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22f6e0d_eae6_4456_bb9b_b333349091a6.slice/crio-8ede0287a15af3fb8bea4cb0158f9a4e7e0884dd861859411d9c2c4fb30fe810 WatchSource:0}: Error finding container 8ede0287a15af3fb8bea4cb0158f9a4e7e0884dd861859411d9c2c4fb30fe810: Status 404 returned error can't find the container with id 8ede0287a15af3fb8bea4cb0158f9a4e7e0884dd861859411d9c2c4fb30fe810
Nov 04 01:33:56.325142 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:56.325109    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:33:56.325216 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:56.325177    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:33:56.325216 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:56.325206    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:33:56.665165 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:56.665080    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk" event={"ID":"c22f6e0d-eae6-4456-bb9b-b333349091a6","Type":"ContainerStarted","Data":"1d9ee14409dcbf87d3bec732a33d836c5b696e9b9aa8c36695b68f2802f37c9e"}
Nov 04 01:33:56.665165 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:56.665138    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk" event={"ID":"c22f6e0d-eae6-4456-bb9b-b333349091a6","Type":"ContainerStarted","Data":"8ede0287a15af3fb8bea4cb0158f9a4e7e0884dd861859411d9c2c4fb30fe810"}
Nov 04 01:33:56.889063 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:56.889031    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:33:57.891209 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:57.891132    5640 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 04 01:33:57.891209 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:57.891184    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk" podUID="c22f6e0d-eae6-4456-bb9b-b333349091a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 04 01:33:58.889585 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:58.889555    5640 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 04 01:33:58.889735 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:58.889607    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk" podUID="c22f6e0d-eae6-4456-bb9b-b333349091a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 04 01:33:59.889221 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:59.889188    5640 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 04 01:33:59.889657 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:33:59.889240    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk" podUID="c22f6e0d-eae6-4456-bb9b-b333349091a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 04 01:34:00.889683 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:00.889647    5640 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 04 01:34:00.890105 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:00.889702    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk" podUID="c22f6e0d-eae6-4456-bb9b-b333349091a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 04 01:34:01.633849 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:01.633824    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc"
Nov 04 01:34:01.634030 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:01.633884    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t"
Nov 04 01:34:01.757463 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:01.757405    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk" podStartSLOduration=6.757384452 podStartE2EDuration="6.757384452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:33:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:33:56.789757856 +0000 UTC m=+1359.342218008" watchObservedRunningTime="2026-11-04 01:34:01.757384452 +0000 UTC m=+1364.309844580"
Nov 04 01:34:01.889442 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:01.889365    5640 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 04 01:34:01.889442 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:01.889413    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk" podUID="c22f6e0d-eae6-4456-bb9b-b333349091a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 04 01:34:02.889790 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:02.889756    5640 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 04 01:34:02.890209 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:02.889822    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk" podUID="c22f6e0d-eae6-4456-bb9b-b333349091a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 04 01:34:03.894454 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:03.894426    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:34:03.894847 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:03.894680    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:34:03.895479 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:03.895461    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:34:04.652188 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:04.652160    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn"
Nov 04 01:34:07.943438 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:07.943404    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn"]
Nov 04 01:34:11.141672 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:34:11.141635    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:34:12.943727 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:12.943685    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn" podUID="5c449355-7ac5-44ba-81ae-2863eb46d99b" containerName="payload-processing" containerID="cri-o://04b248de60fedc54ed6d4aa924999b0f885f4ee74a7e02ad6775b5462192fab9" gracePeriod=25
Nov 04 01:34:13.215986 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:13.215949    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn"
Nov 04 01:34:13.371702 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:13.371662    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5c449355-7ac5-44ba-81ae-2863eb46d99b-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c449355-7ac5-44ba-81ae-2863eb46d99b-plugins-config-volume\") pod \"5c449355-7ac5-44ba-81ae-2863eb46d99b\" (UID: \"5c449355-7ac5-44ba-81ae-2863eb46d99b\") "
Nov 04 01:34:13.371877 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:13.371768    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5c449355-7ac5-44ba-81ae-2863eb46d99b-kube-api-access-dxctl\" (UniqueName: \"kubernetes.io/projected/5c449355-7ac5-44ba-81ae-2863eb46d99b-kube-api-access-dxctl\") pod \"5c449355-7ac5-44ba-81ae-2863eb46d99b\" (UID: \"5c449355-7ac5-44ba-81ae-2863eb46d99b\") "
Nov 04 01:34:13.372003 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:13.371959    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5c449355-7ac5-44ba-81ae-2863eb46d99b-provider-credentials\" (UniqueName: \"kubernetes.io/projected/5c449355-7ac5-44ba-81ae-2863eb46d99b-provider-credentials\") pod \"5c449355-7ac5-44ba-81ae-2863eb46d99b\" (UID: \"5c449355-7ac5-44ba-81ae-2863eb46d99b\") "
Nov 04 01:34:13.372068 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:13.372025    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5c449355-7ac5-44ba-81ae-2863eb46d99b-routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/5c449355-7ac5-44ba-81ae-2863eb46d99b-routing-overlay-volume\") pod \"5c449355-7ac5-44ba-81ae-2863eb46d99b\" (UID: \"5c449355-7ac5-44ba-81ae-2863eb46d99b\") "
Nov 04 01:34:13.372111 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:13.372086    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c449355-7ac5-44ba-81ae-2863eb46d99b-plugins-config-volume" pod "5c449355-7ac5-44ba-81ae-2863eb46d99b" (UID: "5c449355-7ac5-44ba-81ae-2863eb46d99b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:34:13.372400 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:13.372373    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c449355-7ac5-44ba-81ae-2863eb46d99b-routing-overlay-volume" pod "5c449355-7ac5-44ba-81ae-2863eb46d99b" (UID: "5c449355-7ac5-44ba-81ae-2863eb46d99b"). InnerVolumeSpecName "routing-overlay-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:34:13.372530 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:13.372509    5640 reconciler_common.go:299] "Volume detached for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/5c449355-7ac5-44ba-81ae-2863eb46d99b-routing-overlay-volume\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:34:13.372584 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:13.372528    5640 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c449355-7ac5-44ba-81ae-2863eb46d99b-plugins-config-volume\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:34:13.374311 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:13.374287    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c449355-7ac5-44ba-81ae-2863eb46d99b-provider-credentials" pod "5c449355-7ac5-44ba-81ae-2863eb46d99b" (UID: "5c449355-7ac5-44ba-81ae-2863eb46d99b"). InnerVolumeSpecName "provider-credentials". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:34:13.374442 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:13.374419    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c449355-7ac5-44ba-81ae-2863eb46d99b-kube-api-access-dxctl" pod "5c449355-7ac5-44ba-81ae-2863eb46d99b" (UID: "5c449355-7ac5-44ba-81ae-2863eb46d99b"). InnerVolumeSpecName "kube-api-access-dxctl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:34:13.473249 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:13.473172    5640 reconciler_common.go:299] "Volume detached for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/5c449355-7ac5-44ba-81ae-2863eb46d99b-provider-credentials\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:34:13.473249 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:13.473198    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxctl\" (UniqueName: \"kubernetes.io/projected/5c449355-7ac5-44ba-81ae-2863eb46d99b-kube-api-access-dxctl\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:34:13.779440 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:13.779403    5640 generic.go:356] "Generic (PLEG): container finished" podID="5c449355-7ac5-44ba-81ae-2863eb46d99b" containerID="04b248de60fedc54ed6d4aa924999b0f885f4ee74a7e02ad6775b5462192fab9" exitCode=0
Nov 04 01:34:13.779618 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:13.779452    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn"
Nov 04 01:34:13.779618 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:13.779477    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn" event={"ID":"5c449355-7ac5-44ba-81ae-2863eb46d99b","Type":"ContainerDied","Data":"04b248de60fedc54ed6d4aa924999b0f885f4ee74a7e02ad6775b5462192fab9"}
Nov 04 01:34:13.779618 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:13.779537    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn" event={"ID":"5c449355-7ac5-44ba-81ae-2863eb46d99b","Type":"ContainerDied","Data":"4586042e9d01a5ec4221fc8bf46bf58d6c0b64e7bba142d3622cbb61abaf6137"}
Nov 04 01:34:13.779618 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:13.779553    5640 scope.go:122] "RemoveContainer" containerID="04b248de60fedc54ed6d4aa924999b0f885f4ee74a7e02ad6775b5462192fab9"
Nov 04 01:34:13.789029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:13.789008    5640 scope.go:122] "RemoveContainer" containerID="04b248de60fedc54ed6d4aa924999b0f885f4ee74a7e02ad6775b5462192fab9"
Nov 04 01:34:13.789386 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:34:13.789364    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04b248de60fedc54ed6d4aa924999b0f885f4ee74a7e02ad6775b5462192fab9\": container with ID starting with 04b248de60fedc54ed6d4aa924999b0f885f4ee74a7e02ad6775b5462192fab9 not found: ID does not exist" containerID="04b248de60fedc54ed6d4aa924999b0f885f4ee74a7e02ad6775b5462192fab9"
Nov 04 01:34:13.789462 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:13.789395    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b248de60fedc54ed6d4aa924999b0f885f4ee74a7e02ad6775b5462192fab9"} err="failed to get container status \"04b248de60fedc54ed6d4aa924999b0f885f4ee74a7e02ad6775b5462192fab9\": rpc error: code = NotFound desc = could not find container \"04b248de60fedc54ed6d4aa924999b0f885f4ee74a7e02ad6775b5462192fab9\": container with ID starting with 04b248de60fedc54ed6d4aa924999b0f885f4ee74a7e02ad6775b5462192fab9 not found: ID does not exist"
Nov 04 01:34:13.949852 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:13.949824    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn"]
Nov 04 01:34:14.001683 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:14.001645    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["models-as-a-service/payload-processing-external-model-7b4675d6f7-sq4wn"]
Nov 04 01:34:15.567064 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:15.567029    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5c449355-7ac5-44ba-81ae-2863eb46d99b" path="/var/lib/kubelet/pods/5c449355-7ac5-44ba-81ae-2863eb46d99b/volumes"
Nov 04 01:34:31.730368 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:31.730336    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"]
Nov 04 01:34:31.730890 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:31.730834    5640 cpu_manager.go:414] "containerMap: removing container" podUID="5c449355-7ac5-44ba-81ae-2863eb46d99b" containerName="payload-processing"
Nov 04 01:34:31.730890 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:31.730846    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5c449355-7ac5-44ba-81ae-2863eb46d99b" containerName="payload-processing"
Nov 04 01:34:31.730962 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:31.730926    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="5c449355-7ac5-44ba-81ae-2863eb46d99b" containerName="payload-processing"
Nov 04 01:34:31.735615 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:31.735594    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"
Nov 04 01:34:31.790761 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:31.790735    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"]
Nov 04 01:34:31.823345 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:31.823323    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-maas-api-tls\") pod \"maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8\" (UID: \"8fa1c474-6c77-4525-9b7a-b24b5fef9d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"
Nov 04 01:34:31.823463 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:31.823353    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8\" (UID: \"8fa1c474-6c77-4525-9b7a-b24b5fef9d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"
Nov 04 01:34:31.823508 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:31.823475    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hv92\" (UniqueName: \"kubernetes.io/projected/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-kube-api-access-9hv92\") pod \"maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8\" (UID: \"8fa1c474-6c77-4525-9b7a-b24b5fef9d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"
Nov 04 01:34:31.823542 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:31.823513    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-metrics-certs\") pod \"maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8\" (UID: \"8fa1c474-6c77-4525-9b7a-b24b5fef9d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"
Nov 04 01:34:31.838613 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:31.838585    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-extmod-a-b1047d-serving-cert\""
Nov 04 01:34:31.924988 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:31.924922    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-maas-api-tls\") pod \"maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8\" (UID: \"8fa1c474-6c77-4525-9b7a-b24b5fef9d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"
Nov 04 01:34:31.925135 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:31.924979    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8\" (UID: \"8fa1c474-6c77-4525-9b7a-b24b5fef9d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"
Nov 04 01:34:31.925135 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:34:31.925077    5640 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-serving-cert: secret "maas-api-e2e-extmod-a-b1047d-serving-cert" not found
Nov 04 01:34:31.925244 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:31.925140    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hv92\" (UniqueName: \"kubernetes.io/projected/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-kube-api-access-9hv92\") pod \"maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8\" (UID: \"8fa1c474-6c77-4525-9b7a-b24b5fef9d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"
Nov 04 01:34:31.925244 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:34:31.925143    5640 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-maas-api-tls podName:8fa1c474-6c77-4525-9b7a-b24b5fef9d99 nodeName:}" failed. No retries permitted until 2026-11-04 01:34:32.425123508 +0000 UTC m=+1394.977583630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-maas-api-tls") pod "maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8" (UID: "8fa1c474-6c77-4525-9b7a-b24b5fef9d99") : secret "maas-api-e2e-extmod-a-b1047d-serving-cert" not found
Nov 04 01:34:31.925244 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:31.925226    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-metrics-certs\") pod \"maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8\" (UID: \"8fa1c474-6c77-4525-9b7a-b24b5fef9d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"
Nov 04 01:34:31.925615 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:31.925592    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8\" (UID: \"8fa1c474-6c77-4525-9b7a-b24b5fef9d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"
Nov 04 01:34:31.927563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:31.927538    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-metrics-certs\") pod \"maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8\" (UID: \"8fa1c474-6c77-4525-9b7a-b24b5fef9d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"
Nov 04 01:34:31.987840 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:31.987786    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hv92\" (UniqueName: \"kubernetes.io/projected/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-kube-api-access-9hv92\") pod \"maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8\" (UID: \"8fa1c474-6c77-4525-9b7a-b24b5fef9d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"
Nov 04 01:34:32.430117 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:32.430086    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-maas-api-tls\") pod \"maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8\" (UID: \"8fa1c474-6c77-4525-9b7a-b24b5fef9d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"
Nov 04 01:34:32.432214 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:32.432191    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-maas-api-tls\") pod \"maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8\" (UID: \"8fa1c474-6c77-4525-9b7a-b24b5fef9d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"
Nov 04 01:34:32.648188 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:32.648160    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"
Nov 04 01:34:33.024481 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:33.024457    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"]
Nov 04 01:34:33.025105 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:34:33.025076    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa1c474_6c77_4525_9b7a_b24b5fef9d99.slice/crio-7340c30acab7c8f7b29572f4807a475b4105e4627d52419ee66a15a975e859be WatchSource:0}: Error finding container 7340c30acab7c8f7b29572f4807a475b4105e4627d52419ee66a15a975e859be: Status 404 returned error can't find the container with id 7340c30acab7c8f7b29572f4807a475b4105e4627d52419ee66a15a975e859be
Nov 04 01:34:33.026328 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:33.026310    5640 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 01:34:33.896317 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:33.896284    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8" event={"ID":"8fa1c474-6c77-4525-9b7a-b24b5fef9d99","Type":"ContainerStarted","Data":"7340c30acab7c8f7b29572f4807a475b4105e4627d52419ee66a15a975e859be"}
Nov 04 01:34:34.911058 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:34.911024    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8" event={"ID":"8fa1c474-6c77-4525-9b7a-b24b5fef9d99","Type":"ContainerStarted","Data":"bc0b8186507835bbaa4b367dfce2a0f5da1c40d1e703a8e13bc6a39643f239fa"}
Nov 04 01:34:34.911529 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:34.911127    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"
Nov 04 01:34:35.033930 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:35.033877    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8" podStartSLOduration=3.031713707 podStartE2EDuration="4.03386481s" totalImagesPullingTime="1.002151103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:34:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:34:35.031712275 +0000 UTC m=+1397.584172412" watchObservedRunningTime="2026-11-04 01:34:35.03386481 +0000 UTC m=+1397.586324936"
Nov 04 01:34:40.922214 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:40.922186    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"
Nov 04 01:34:41.141353 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:34:41.141321    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:34:42.470276 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.470250    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"]
Nov 04 01:34:42.474146 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.474129    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.527998 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.527936    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-kcfvk\""
Nov 04 01:34:42.596025 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.596004    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"]
Nov 04 01:34:42.635149 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.635120    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.635282 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.635168    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.635410 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.635314    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.635469 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.635425    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.635512 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.635480    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.635512 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.635500    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.635591 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.635519    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.635624 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.635609    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.635656 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.635625    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmxnk\" (UniqueName: \"kubernetes.io/projected/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-kube-api-access-fmxnk\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.737022 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.736945    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.737022 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.737012    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmxnk\" (UniqueName: \"kubernetes.io/projected/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-kube-api-access-fmxnk\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.737222 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.737038    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.737222 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.737065    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.737222 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.737140    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.737222 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.737212    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.737436 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.737260    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.737436 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.737303    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.737542 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.737463    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.737737 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.737708    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.737869 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.737334    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.737869 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.737775    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.738031 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.737906    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.738085 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.738029    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.739317 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.739292    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.739937 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.739920    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.800028 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.800007    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:42.800142 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:42.800124    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmxnk\" (UniqueName: \"kubernetes.io/projected/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-kube-api-access-fmxnk\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-q6lf6\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:43.086996 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:43.086952    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:43.517074 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:43.517031    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"]
Nov 04 01:34:43.518074 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:34:43.518049    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a0bbdfa_19b8_4bb5_ab32_2f3cb008bb5a.slice/crio-f058dc6240d7147455b0c7af83427c80e3ccab236824dff67f8fa8522d1d6718 WatchSource:0}: Error finding container f058dc6240d7147455b0c7af83427c80e3ccab236824dff67f8fa8522d1d6718: Status 404 returned error can't find the container with id f058dc6240d7147455b0c7af83427c80e3ccab236824dff67f8fa8522d1d6718
Nov 04 01:34:43.520855 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:43.520822    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:34:43.520918 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:43.520889    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:34:43.520959 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:43.520918    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:34:43.968243 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:43.968203    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6" event={"ID":"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a","Type":"ContainerStarted","Data":"f214991954acc682e3298c53a02917503b222a6dbc4f011e877c120ab150c350"}
Nov 04 01:34:43.968436 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:43.968267    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6" event={"ID":"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a","Type":"ContainerStarted","Data":"f058dc6240d7147455b0c7af83427c80e3ccab236824dff67f8fa8522d1d6718"}
Nov 04 01:34:44.087079 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:44.087046    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:44.088752 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:44.088726    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Nov 04 01:34:44.088878 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:44.088775    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6" podUID="1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Nov 04 01:34:45.087303 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:45.087270    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Nov 04 01:34:45.087679 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:45.087318    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6" podUID="1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Nov 04 01:34:46.088142 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:46.088110    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Nov 04 01:34:46.088528 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:46.088159    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6" podUID="1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Nov 04 01:34:47.087520 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:47.087484    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Nov 04 01:34:47.087682 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:47.087565    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6" podUID="1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Nov 04 01:34:48.088352 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:48.088321    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Nov 04 01:34:48.088716 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:48.088383    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6" podUID="1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Nov 04 01:34:49.087571 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:49.087538    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Nov 04 01:34:49.087751 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:49.087593    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6" podUID="1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Nov 04 01:34:50.087458 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:50.087419    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Nov 04 01:34:50.087828 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:50.087483    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6" podUID="1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Nov 04 01:34:51.087682 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:51.087646    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Nov 04 01:34:51.088068 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:51.087714    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6" podUID="1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Nov 04 01:34:52.127739 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:52.127711    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:52.128245 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:52.128059    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:52.128884 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:52.128864    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:34:52.304945 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:34:52.304895    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6" podStartSLOduration=10.304881777 podStartE2EDuration="10.304881777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:34:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:34:44.162000141 +0000 UTC m=+1406.714460294" watchObservedRunningTime="2026-11-04 01:34:52.304881777 +0000 UTC m=+1414.857341901"
Nov 04 01:35:11.141079 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:35:11.141041    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:35:41.141273 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:35:41.141242    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:35:42.020094 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.020065    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"]
Nov 04 01:35:42.023787 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.023770    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.080520 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.080492    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-extmod-b-1225f3-openshift-default-dockercfg-67r5l\""
Nov 04 01:35:42.136353 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.136326    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"]
Nov 04 01:35:42.173858 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.173825    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-workload-socket\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.174322 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.173927    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-workload-certs\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.174322 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.173985    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-credential-socket\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.174322 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.174010    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-envoy\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.174322 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.174095    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8vwd\" (UniqueName: \"kubernetes.io/projected/31772fc6-bc9a-4d40-a587-914fffa131a6-kube-api-access-m8vwd\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.174322 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.174174    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-token\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.174322 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.174203    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-data\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.174322 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.174256    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-podinfo\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.174322 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.174280    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31772fc6-bc9a-4d40-a587-914fffa131a6-istiod-ca-cert\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.275579 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.275550    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-podinfo\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.275767 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.275585    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31772fc6-bc9a-4d40-a587-914fffa131a6-istiod-ca-cert\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.275767 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.275658    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-workload-socket\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.275767 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.275685    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-workload-certs\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.275767 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.275729    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-credential-socket\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.275767 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.275756    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-envoy\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.276065 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.275805    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8vwd\" (UniqueName: \"kubernetes.io/projected/31772fc6-bc9a-4d40-a587-914fffa131a6-kube-api-access-m8vwd\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.276065 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.275887    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-token\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.276065 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.275920    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-data\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.276205 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.276167    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-workload-socket\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.276269 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.276225    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-workload-certs\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.276318 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.276302    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-credential-socket\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.276453 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.276429    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-data\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.276574 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.276555    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31772fc6-bc9a-4d40-a587-914fffa131a6-istiod-ca-cert\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.278062 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.278043    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-envoy\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.278356 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.278338    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-podinfo\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.340293 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.340270    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8vwd\" (UniqueName: \"kubernetes.io/projected/31772fc6-bc9a-4d40-a587-914fffa131a6-kube-api-access-m8vwd\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.340653 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.340631    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-token\") pod \"e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") " pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:42.636837 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:42.636749    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:43.070522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:43.070495    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"]
Nov 04 01:35:43.071307 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:35:43.071281    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31772fc6_bc9a_4d40_a587_914fffa131a6.slice/crio-9e7ad1736b2df559f6f82951570c4f8bc6ec76f680571054c88f318bb84f482f WatchSource:0}: Error finding container 9e7ad1736b2df559f6f82951570c4f8bc6ec76f680571054c88f318bb84f482f: Status 404 returned error can't find the container with id 9e7ad1736b2df559f6f82951570c4f8bc6ec76f680571054c88f318bb84f482f
Nov 04 01:35:43.073803 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:43.073771    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:35:43.073879 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:43.073833    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:35:43.073879 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:43.073861    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:35:43.343629 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:43.343551    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh" event={"ID":"31772fc6-bc9a-4d40-a587-914fffa131a6","Type":"ContainerStarted","Data":"3913e217e7f3d33bd23f79ce441b4af894c6342559f8eccb5b105b7bb8408e44"}
Nov 04 01:35:43.343629 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:43.343608    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh" event={"ID":"31772fc6-bc9a-4d40-a587-914fffa131a6","Type":"ContainerStarted","Data":"9e7ad1736b2df559f6f82951570c4f8bc6ec76f680571054c88f318bb84f482f"}
Nov 04 01:35:43.467943 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:43.467884    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh" podStartSLOduration=2.467865807 podStartE2EDuration="2.467865807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:35:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:35:43.465942085 +0000 UTC m=+1466.018402210" watchObservedRunningTime="2026-11-04 01:35:43.467865807 +0000 UTC m=+1466.020325936"
Nov 04 01:35:43.637264 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:43.637183    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:44.642206 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:44.642178    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:45.354552 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:45.354517    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:45.355444 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:45.355421    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:35:50.784570 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:50.784536    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"]
Nov 04 01:35:50.836269 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:50.836234    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"]
Nov 04 01:35:50.838764 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:50.838737    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"]
Nov 04 01:35:58.040265 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.040224    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"]
Nov 04 01:35:58.044451 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.044419    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.091816 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.091779    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"]
Nov 04 01:35:58.095742 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.095721    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.143656 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.143615    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"]
Nov 04 01:35:58.160868 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.160814    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.161060 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.160881    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.161060 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.161016    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bshw2\" (UniqueName: \"kubernetes.io/projected/3006ea70-cf33-45cc-9321-1ba3daa5bea9-kube-api-access-bshw2\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.161146 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.161070    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.161193 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.161165    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5sw5\" (UniqueName: \"kubernetes.io/projected/65a6272a-e527-4b6c-b7cf-760b742e41c9-kube-api-access-d5sw5\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.161255 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.161221    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.161299 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.161283    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.161340 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.161328    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.161379 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.161354    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.161455 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.161437    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.161499 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.161485    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.161563 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.161547    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.161603 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.161579    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.161642 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.161627    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.161678 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.161656    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.161712 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.161688    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.161751 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.161739    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65a6272a-e527-4b6c-b7cf-760b742e41c9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.161788 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.161767    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.207861 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.207824    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"]
Nov 04 01:35:58.263703 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.263650    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.263893 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.263717    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.263893 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.263775    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.263893 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.263804    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.263893 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.263850    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.263893 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.263877    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.264233 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.263910    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.264233 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.263961    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65a6272a-e527-4b6c-b7cf-760b742e41c9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.264233 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.264025    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.264233 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.264095    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.264233 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.264123    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.264233 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.264153    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bshw2\" (UniqueName: \"kubernetes.io/projected/3006ea70-cf33-45cc-9321-1ba3daa5bea9-kube-api-access-bshw2\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.264233 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.264196    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.264233 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.264205    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.264642 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.264244    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5sw5\" (UniqueName: \"kubernetes.io/projected/65a6272a-e527-4b6c-b7cf-760b742e41c9-kube-api-access-d5sw5\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.264642 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.264299    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.264642 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.264342    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.264642 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.264387    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.264642 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.264414    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.264642 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.264452    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.264943 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.264811    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.264943 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.264863    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.265093 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.265072    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.265740 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.265713    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65a6272a-e527-4b6c-b7cf-760b742e41c9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.266411 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.266381    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.266646 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.266623    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.266758 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.266732    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.267699 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.267667    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.268716 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.268695    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.270214 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.270173    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.270313 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.270211    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.270725 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.270700    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.327419 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.327331    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.327419 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.327376    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5sw5\" (UniqueName: \"kubernetes.io/projected/65a6272a-e527-4b6c-b7cf-760b742e41c9-kube-api-access-d5sw5\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-gh8zv\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.327812 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.327786    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.327855 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.327806    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bshw2\" (UniqueName: \"kubernetes.io/projected/3006ea70-cf33-45cc-9321-1ba3daa5bea9-kube-api-access-bshw2\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-t9ljt\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.363106 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.363063    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:35:58.413792 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.413759    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:35:58.805063 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:35:58.805023    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3006ea70_cf33_45cc_9321_1ba3daa5bea9.slice/crio-c951efc9c4bbff689d75560f7844de79fe533887228f632c3e42b803f26b2646 WatchSource:0}: Error finding container c951efc9c4bbff689d75560f7844de79fe533887228f632c3e42b803f26b2646: Status 404 returned error can't find the container with id c951efc9c4bbff689d75560f7844de79fe533887228f632c3e42b803f26b2646
Nov 04 01:35:58.805323 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.805297    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"]
Nov 04 01:35:58.808211 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.808176    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:35:58.808320 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.808258    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:35:58.808320 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.808305    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:35:58.909347 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.909313    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"]
Nov 04 01:35:58.917201 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.917168    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:35:58.917300 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.917242    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:35:58.917300 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:58.917274    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:35:59.458088 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:59.458049    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt" event={"ID":"3006ea70-cf33-45cc-9321-1ba3daa5bea9","Type":"ContainerStarted","Data":"6b7a6a2315052a5ced4b9f9dfda1b2600b7fee5149682f313aa06ae4605d51fb"}
Nov 04 01:35:59.458709 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:59.458678    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt" event={"ID":"3006ea70-cf33-45cc-9321-1ba3daa5bea9","Type":"ContainerStarted","Data":"c951efc9c4bbff689d75560f7844de79fe533887228f632c3e42b803f26b2646"}
Nov 04 01:35:59.467810 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:59.467776    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv" event={"ID":"65a6272a-e527-4b6c-b7cf-760b742e41c9","Type":"ContainerStarted","Data":"7966dff5996b0431a60ddd42d9ed203f9c2a9c3d211a1ef12af9990f777fde99"}
Nov 04 01:35:59.468065 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:59.468044    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv" event={"ID":"65a6272a-e527-4b6c-b7cf-760b742e41c9","Type":"ContainerStarted","Data":"583cf9b0820aef4f6743e951fe0b1eb4e5e7a4fcae81dbe4fe98029bf168c0c9"}
Nov 04 01:35:59.607570 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:59.605535    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt" podStartSLOduration=2.6055133230000003 podStartE2EDuration="2.605513323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:35:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:35:59.583356618 +0000 UTC m=+1482.135816768" watchObservedRunningTime="2026-11-04 01:35:59.605513323 +0000 UTC m=+1482.157973453"
Nov 04 01:35:59.711450 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:35:59.711337    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv" podStartSLOduration=1.711321111 podStartE2EDuration="1.711321111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:35:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:35:59.708187096 +0000 UTC m=+1482.260647223" watchObservedRunningTime="2026-11-04 01:35:59.711321111 +0000 UTC m=+1482.263781235"
Nov 04 01:36:00.367308 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:00.366297    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:36:00.388992 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:00.372219    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Nov 04 01:36:00.388992 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:00.372286    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt" podUID="3006ea70-cf33-45cc-9321-1ba3daa5bea9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Nov 04 01:36:00.414338 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:00.414247    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:36:00.415538 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:00.415509    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Nov 04 01:36:00.415673 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:00.415560    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv" podUID="65a6272a-e527-4b6c-b7cf-760b742e41c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Nov 04 01:36:01.371996 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:01.368098    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Nov 04 01:36:01.371996 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:01.368169    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt" podUID="3006ea70-cf33-45cc-9321-1ba3daa5bea9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Nov 04 01:36:01.414402 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:01.414362    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Nov 04 01:36:01.414607 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:01.414425    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv" podUID="65a6272a-e527-4b6c-b7cf-760b742e41c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Nov 04 01:36:02.367905 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:02.367444    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Nov 04 01:36:02.367905 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:02.367508    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt" podUID="3006ea70-cf33-45cc-9321-1ba3daa5bea9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Nov 04 01:36:02.414289 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:02.414254    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Nov 04 01:36:02.414645 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:02.414318    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv" podUID="65a6272a-e527-4b6c-b7cf-760b742e41c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Nov 04 01:36:03.364518 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:03.364464    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Nov 04 01:36:03.364890 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:03.364860    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt" podUID="3006ea70-cf33-45cc-9321-1ba3daa5bea9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Nov 04 01:36:03.414533 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:03.414490    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Nov 04 01:36:03.415008 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:03.414547    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv" podUID="65a6272a-e527-4b6c-b7cf-760b742e41c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Nov 04 01:36:04.364993 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:04.364439    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Nov 04 01:36:04.364993 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:04.364505    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt" podUID="3006ea70-cf33-45cc-9321-1ba3daa5bea9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Nov 04 01:36:04.414583 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:04.414539    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Nov 04 01:36:04.415007 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:04.414616    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv" podUID="65a6272a-e527-4b6c-b7cf-760b742e41c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Nov 04 01:36:05.363999 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:05.363931    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Nov 04 01:36:05.364182 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:05.364041    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt" podUID="3006ea70-cf33-45cc-9321-1ba3daa5bea9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Nov 04 01:36:05.414697 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:05.414659    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Nov 04 01:36:05.415406 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:05.415366    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv" podUID="65a6272a-e527-4b6c-b7cf-760b742e41c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Nov 04 01:36:05.805799 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:05.805761    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq" podUID="3042f316-58e3-4939-b9e9-bbf4396fa23d" containerName="main" containerID="cri-o://19bd6978a513849686190ec658066906a784ee8efdd7f536dd54243cc2e4d4c7" gracePeriod=45
Nov 04 01:36:05.857773 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:05.857700    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz" podUID="8768bc1c-ab77-4d40-9f39-94787e4e08f0" containerName="main" containerID="cri-o://31b1fe853c72f3ac01a6c32e01acb95e76868ea0850ae7ff0dae62b0a10a0e61" gracePeriod=45
Nov 04 01:36:05.859538 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:05.859457    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v" podUID="ad652044-a765-43b7-b77d-d929324086de" containerName="main" containerID="cri-o://1e7f5d5047573bccc92c083b13baa372966eb5f422397248d4f0f5f96bcfb16b" gracePeriod=45
Nov 04 01:36:06.219455 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.219425    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:36:06.226165 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.226079    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:36:06.231385 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.231367    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:36:06.244044 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.244016    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-dshm\" (UniqueName: \"kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-dshm\") pod \"3042f316-58e3-4939-b9e9-bbf4396fa23d\" (UID: \"3042f316-58e3-4939-b9e9-bbf4396fa23d\") "
Nov 04 01:36:06.244273 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.244140    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-home\" (UniqueName: \"kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-home\") pod \"3042f316-58e3-4939-b9e9-bbf4396fa23d\" (UID: \"3042f316-58e3-4939-b9e9-bbf4396fa23d\") "
Nov 04 01:36:06.244273 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.244198    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-tmp-dir\") pod \"3042f316-58e3-4939-b9e9-bbf4396fa23d\" (UID: \"3042f316-58e3-4939-b9e9-bbf4396fa23d\") "
Nov 04 01:36:06.244273 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.244237    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3042f316-58e3-4939-b9e9-bbf4396fa23d-tls-certs\" (UniqueName: \"kubernetes.io/secret/3042f316-58e3-4939-b9e9-bbf4396fa23d-tls-certs\") pod \"3042f316-58e3-4939-b9e9-bbf4396fa23d\" (UID: \"3042f316-58e3-4939-b9e9-bbf4396fa23d\") "
Nov 04 01:36:06.244577 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.244309    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3042f316-58e3-4939-b9e9-bbf4396fa23d-kube-api-access-vhr4l\" (UniqueName: \"kubernetes.io/projected/3042f316-58e3-4939-b9e9-bbf4396fa23d-kube-api-access-vhr4l\") pod \"3042f316-58e3-4939-b9e9-bbf4396fa23d\" (UID: \"3042f316-58e3-4939-b9e9-bbf4396fa23d\") "
Nov 04 01:36:06.244577 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.244362    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-model-cache\") pod \"3042f316-58e3-4939-b9e9-bbf4396fa23d\" (UID: \"3042f316-58e3-4939-b9e9-bbf4396fa23d\") "
Nov 04 01:36:06.244911 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.244891    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-model-cache" pod "3042f316-58e3-4939-b9e9-bbf4396fa23d" (UID: "3042f316-58e3-4939-b9e9-bbf4396fa23d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:36:06.245322 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.245286    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-tmp-dir" pod "3042f316-58e3-4939-b9e9-bbf4396fa23d" (UID: "3042f316-58e3-4939-b9e9-bbf4396fa23d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:36:06.245676 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.245644    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-home" pod "3042f316-58e3-4939-b9e9-bbf4396fa23d" (UID: "3042f316-58e3-4939-b9e9-bbf4396fa23d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:36:06.247488 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.247416    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-dshm" pod "3042f316-58e3-4939-b9e9-bbf4396fa23d" (UID: "3042f316-58e3-4939-b9e9-bbf4396fa23d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:36:06.247488 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.247452    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3042f316-58e3-4939-b9e9-bbf4396fa23d-tls-certs" pod "3042f316-58e3-4939-b9e9-bbf4396fa23d" (UID: "3042f316-58e3-4939-b9e9-bbf4396fa23d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:36:06.247488 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.247461    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3042f316-58e3-4939-b9e9-bbf4396fa23d-kube-api-access-vhr4l" pod "3042f316-58e3-4939-b9e9-bbf4396fa23d" (UID: "3042f316-58e3-4939-b9e9-bbf4396fa23d"). InnerVolumeSpecName "kube-api-access-vhr4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:36:06.347278 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.347191    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8768bc1c-ab77-4d40-9f39-94787e4e08f0-tls-certs\" (UniqueName: \"kubernetes.io/secret/8768bc1c-ab77-4d40-9f39-94787e4e08f0-tls-certs\") pod \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\" (UID: \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\") "
Nov 04 01:36:06.347546 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.347525    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8768bc1c-ab77-4d40-9f39-94787e4e08f0-kube-api-access-zgvc2\" (UniqueName: \"kubernetes.io/projected/8768bc1c-ab77-4d40-9f39-94787e4e08f0-kube-api-access-zgvc2\") pod \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\" (UID: \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\") "
Nov 04 01:36:06.347702 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.347687    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-home\" (UniqueName: \"kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-home\") pod \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\" (UID: \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\") "
Nov 04 01:36:06.347883 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.347865    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-model-cache\") pod \"ad652044-a765-43b7-b77d-d929324086de\" (UID: \"ad652044-a765-43b7-b77d-d929324086de\") "
Nov 04 01:36:06.348109 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.348090    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-tmp-dir\") pod \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\" (UID: \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\") "
Nov 04 01:36:06.348249 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.348234    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-home\" (UniqueName: \"kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-home\") pod \"ad652044-a765-43b7-b77d-d929324086de\" (UID: \"ad652044-a765-43b7-b77d-d929324086de\") "
Nov 04 01:36:06.348404 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.348388    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ad652044-a765-43b7-b77d-d929324086de-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad652044-a765-43b7-b77d-d929324086de-tls-certs\") pod \"ad652044-a765-43b7-b77d-d929324086de\" (UID: \"ad652044-a765-43b7-b77d-d929324086de\") "
Nov 04 01:36:06.348545 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.348530    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-tmp-dir\") pod \"ad652044-a765-43b7-b77d-d929324086de\" (UID: \"ad652044-a765-43b7-b77d-d929324086de\") "
Nov 04 01:36:06.348710 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.348692    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-model-cache\") pod \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\" (UID: \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\") "
Nov 04 01:36:06.348864 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.348847    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad652044-a765-43b7-b77d-d929324086de-kube-api-access-h9mbt\" (UniqueName: \"kubernetes.io/projected/ad652044-a765-43b7-b77d-d929324086de-kube-api-access-h9mbt\") pod \"ad652044-a765-43b7-b77d-d929324086de\" (UID: \"ad652044-a765-43b7-b77d-d929324086de\") "
Nov 04 01:36:06.349029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.349010    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-dshm\" (UniqueName: \"kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-dshm\") pod \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\" (UID: \"8768bc1c-ab77-4d40-9f39-94787e4e08f0\") "
Nov 04 01:36:06.349218 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.349199    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-dshm\") pod \"ad652044-a765-43b7-b77d-d929324086de\" (UID: \"ad652044-a765-43b7-b77d-d929324086de\") "
Nov 04 01:36:06.349874 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.349850    5640 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-tmp-dir\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:06.350017 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.350003    5640 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3042f316-58e3-4939-b9e9-bbf4396fa23d-tls-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:06.350126 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.350113    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhr4l\" (UniqueName: \"kubernetes.io/projected/3042f316-58e3-4939-b9e9-bbf4396fa23d-kube-api-access-vhr4l\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:06.350221 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.350208    5640 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-model-cache\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:06.350311 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.350299    5640 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-dshm\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:06.350398 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.350388    5640 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3042f316-58e3-4939-b9e9-bbf4396fa23d-home\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:06.353711 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.353348    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-model-cache" pod "8768bc1c-ab77-4d40-9f39-94787e4e08f0" (UID: "8768bc1c-ab77-4d40-9f39-94787e4e08f0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:36:06.353711 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.353527    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-tmp-dir" pod "ad652044-a765-43b7-b77d-d929324086de" (UID: "ad652044-a765-43b7-b77d-d929324086de"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:36:06.358293 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.358118    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-model-cache" pod "ad652044-a765-43b7-b77d-d929324086de" (UID: "ad652044-a765-43b7-b77d-d929324086de"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:36:06.358598 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.358431    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-home" pod "8768bc1c-ab77-4d40-9f39-94787e4e08f0" (UID: "8768bc1c-ab77-4d40-9f39-94787e4e08f0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:36:06.358908 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.358729    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-tmp-dir" pod "8768bc1c-ab77-4d40-9f39-94787e4e08f0" (UID: "8768bc1c-ab77-4d40-9f39-94787e4e08f0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:36:06.359407 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.359065    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-home" pod "ad652044-a765-43b7-b77d-d929324086de" (UID: "ad652044-a765-43b7-b77d-d929324086de"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:36:06.364859 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.364738    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Nov 04 01:36:06.364859 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.364803    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt" podUID="3006ea70-cf33-45cc-9321-1ba3daa5bea9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Nov 04 01:36:06.365347 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.365327    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-dshm" pod "8768bc1c-ab77-4d40-9f39-94787e4e08f0" (UID: "8768bc1c-ab77-4d40-9f39-94787e4e08f0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:36:06.365959 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.365881    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8768bc1c-ab77-4d40-9f39-94787e4e08f0-tls-certs" pod "8768bc1c-ab77-4d40-9f39-94787e4e08f0" (UID: "8768bc1c-ab77-4d40-9f39-94787e4e08f0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:36:06.366263 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.366210    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8768bc1c-ab77-4d40-9f39-94787e4e08f0-kube-api-access-zgvc2" pod "8768bc1c-ab77-4d40-9f39-94787e4e08f0" (UID: "8768bc1c-ab77-4d40-9f39-94787e4e08f0"). InnerVolumeSpecName "kube-api-access-zgvc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:36:06.367739 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.367717    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad652044-a765-43b7-b77d-d929324086de-kube-api-access-h9mbt" pod "ad652044-a765-43b7-b77d-d929324086de" (UID: "ad652044-a765-43b7-b77d-d929324086de"). InnerVolumeSpecName "kube-api-access-h9mbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:36:06.367827 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.367786    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad652044-a765-43b7-b77d-d929324086de-tls-certs" pod "ad652044-a765-43b7-b77d-d929324086de" (UID: "ad652044-a765-43b7-b77d-d929324086de"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:36:06.371593 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.371556    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-dshm" pod "ad652044-a765-43b7-b77d-d929324086de" (UID: "ad652044-a765-43b7-b77d-d929324086de"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:36:06.414849 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.414798    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Nov 04 01:36:06.415368 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.414861    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv" podUID="65a6272a-e527-4b6c-b7cf-760b742e41c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Nov 04 01:36:06.452338 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.452296    5640 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-dshm\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:06.452338 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.452338    5640 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8768bc1c-ab77-4d40-9f39-94787e4e08f0-tls-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:06.452541 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.452357    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgvc2\" (UniqueName: \"kubernetes.io/projected/8768bc1c-ab77-4d40-9f39-94787e4e08f0-kube-api-access-zgvc2\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:06.452541 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.452372    5640 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-home\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:06.452541 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.452391    5640 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-model-cache\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:06.452541 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.452407    5640 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-tmp-dir\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:06.452541 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.452420    5640 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-home\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:06.452541 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.452434    5640 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad652044-a765-43b7-b77d-d929324086de-tls-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:06.452541 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.452449    5640 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad652044-a765-43b7-b77d-d929324086de-tmp-dir\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:06.452541 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.452462    5640 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-model-cache\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:06.452541 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.452476    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9mbt\" (UniqueName: \"kubernetes.io/projected/ad652044-a765-43b7-b77d-d929324086de-kube-api-access-h9mbt\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:06.452541 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.452491    5640 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8768bc1c-ab77-4d40-9f39-94787e4e08f0-dshm\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:06.641691 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.641596    5640 generic.go:356] "Generic (PLEG): container finished" podID="ad652044-a765-43b7-b77d-d929324086de" containerID="1e7f5d5047573bccc92c083b13baa372966eb5f422397248d4f0f5f96bcfb16b" exitCode=0
Nov 04 01:36:06.641691 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.641638    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"
Nov 04 01:36:06.641930 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.641680    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v" event={"ID":"ad652044-a765-43b7-b77d-d929324086de","Type":"ContainerDied","Data":"1e7f5d5047573bccc92c083b13baa372966eb5f422397248d4f0f5f96bcfb16b"}
Nov 04 01:36:06.641930 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.641728    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v" event={"ID":"ad652044-a765-43b7-b77d-d929324086de","Type":"ContainerDied","Data":"c0be7fcaf304c3bce9523cd6277a7a1be2d8d9d550f47029fd614fc3b6e94535"}
Nov 04 01:36:06.641930 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.641757    5640 scope.go:122] "RemoveContainer" containerID="1e7f5d5047573bccc92c083b13baa372966eb5f422397248d4f0f5f96bcfb16b"
Nov 04 01:36:06.643600 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.643577    5640 generic.go:356] "Generic (PLEG): container finished" podID="8768bc1c-ab77-4d40-9f39-94787e4e08f0" containerID="31b1fe853c72f3ac01a6c32e01acb95e76868ea0850ae7ff0dae62b0a10a0e61" exitCode=0
Nov 04 01:36:06.643716 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.643628    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"
Nov 04 01:36:06.643716 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.643664    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz" event={"ID":"8768bc1c-ab77-4d40-9f39-94787e4e08f0","Type":"ContainerDied","Data":"31b1fe853c72f3ac01a6c32e01acb95e76868ea0850ae7ff0dae62b0a10a0e61"}
Nov 04 01:36:06.643716 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.643693    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz" event={"ID":"8768bc1c-ab77-4d40-9f39-94787e4e08f0","Type":"ContainerDied","Data":"aceb68e3172f0935aeac6659be8f6349708bd9944459b564fbd8dfdc1bbb111e"}
Nov 04 01:36:06.645416 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.645391    5640 generic.go:356] "Generic (PLEG): container finished" podID="3042f316-58e3-4939-b9e9-bbf4396fa23d" containerID="19bd6978a513849686190ec658066906a784ee8efdd7f536dd54243cc2e4d4c7" exitCode=0
Nov 04 01:36:06.645527 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.645482    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq" event={"ID":"3042f316-58e3-4939-b9e9-bbf4396fa23d","Type":"ContainerDied","Data":"19bd6978a513849686190ec658066906a784ee8efdd7f536dd54243cc2e4d4c7"}
Nov 04 01:36:06.645527 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.645507    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq" event={"ID":"3042f316-58e3-4939-b9e9-bbf4396fa23d","Type":"ContainerDied","Data":"923ef98cd040c888fde0ad7c7d2056a9ece4631e3b4e8000a45e14b091a27d6e"}
Nov 04 01:36:06.645636 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.645564    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"
Nov 04 01:36:06.656681 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.656664    5640 scope.go:122] "RemoveContainer" containerID="1e7f5d5047573bccc92c083b13baa372966eb5f422397248d4f0f5f96bcfb16b"
Nov 04 01:36:06.657360 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:36:06.657340    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e7f5d5047573bccc92c083b13baa372966eb5f422397248d4f0f5f96bcfb16b\": container with ID starting with 1e7f5d5047573bccc92c083b13baa372966eb5f422397248d4f0f5f96bcfb16b not found: ID does not exist" containerID="1e7f5d5047573bccc92c083b13baa372966eb5f422397248d4f0f5f96bcfb16b"
Nov 04 01:36:06.657457 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.657371    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e7f5d5047573bccc92c083b13baa372966eb5f422397248d4f0f5f96bcfb16b"} err="failed to get container status \"1e7f5d5047573bccc92c083b13baa372966eb5f422397248d4f0f5f96bcfb16b\": rpc error: code = NotFound desc = could not find container \"1e7f5d5047573bccc92c083b13baa372966eb5f422397248d4f0f5f96bcfb16b\": container with ID starting with 1e7f5d5047573bccc92c083b13baa372966eb5f422397248d4f0f5f96bcfb16b not found: ID does not exist"
Nov 04 01:36:06.657457 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.657397    5640 scope.go:122] "RemoveContainer" containerID="31b1fe853c72f3ac01a6c32e01acb95e76868ea0850ae7ff0dae62b0a10a0e61"
Nov 04 01:36:06.669920 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.669897    5640 scope.go:122] "RemoveContainer" containerID="31b1fe853c72f3ac01a6c32e01acb95e76868ea0850ae7ff0dae62b0a10a0e61"
Nov 04 01:36:06.670261 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:36:06.670239    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31b1fe853c72f3ac01a6c32e01acb95e76868ea0850ae7ff0dae62b0a10a0e61\": container with ID starting with 31b1fe853c72f3ac01a6c32e01acb95e76868ea0850ae7ff0dae62b0a10a0e61 not found: ID does not exist" containerID="31b1fe853c72f3ac01a6c32e01acb95e76868ea0850ae7ff0dae62b0a10a0e61"
Nov 04 01:36:06.670365 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.670275    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31b1fe853c72f3ac01a6c32e01acb95e76868ea0850ae7ff0dae62b0a10a0e61"} err="failed to get container status \"31b1fe853c72f3ac01a6c32e01acb95e76868ea0850ae7ff0dae62b0a10a0e61\": rpc error: code = NotFound desc = could not find container \"31b1fe853c72f3ac01a6c32e01acb95e76868ea0850ae7ff0dae62b0a10a0e61\": container with ID starting with 31b1fe853c72f3ac01a6c32e01acb95e76868ea0850ae7ff0dae62b0a10a0e61 not found: ID does not exist"
Nov 04 01:36:06.670365 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.670305    5640 scope.go:122] "RemoveContainer" containerID="19bd6978a513849686190ec658066906a784ee8efdd7f536dd54243cc2e4d4c7"
Nov 04 01:36:06.679367 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.679344    5640 scope.go:122] "RemoveContainer" containerID="19bd6978a513849686190ec658066906a784ee8efdd7f536dd54243cc2e4d4c7"
Nov 04 01:36:06.679701 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:36:06.679676    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19bd6978a513849686190ec658066906a784ee8efdd7f536dd54243cc2e4d4c7\": container with ID starting with 19bd6978a513849686190ec658066906a784ee8efdd7f536dd54243cc2e4d4c7 not found: ID does not exist" containerID="19bd6978a513849686190ec658066906a784ee8efdd7f536dd54243cc2e4d4c7"
Nov 04 01:36:06.679772 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.679714    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19bd6978a513849686190ec658066906a784ee8efdd7f536dd54243cc2e4d4c7"} err="failed to get container status \"19bd6978a513849686190ec658066906a784ee8efdd7f536dd54243cc2e4d4c7\": rpc error: code = NotFound desc = could not find container \"19bd6978a513849686190ec658066906a784ee8efdd7f536dd54243cc2e4d4c7\": container with ID starting with 19bd6978a513849686190ec658066906a784ee8efdd7f536dd54243cc2e4d4c7 not found: ID does not exist"
Nov 04 01:36:06.812166 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.812132    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"]
Nov 04 01:36:06.818445 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.818411    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-1baf54/simulator-w1-1baf54-kserve-5df6c9c647-qdz2v"]
Nov 04 01:36:06.932367 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.932285    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"]
Nov 04 01:36:06.938418 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:06.938385    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq"]
Nov 04 01:36:07.051308 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:07.051277    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"]
Nov 04 01:36:07.059008 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:07.058982    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz"]
Nov 04 01:36:07.150903 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:07.150861    5640 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-1baf54/premium-w1-1baf54-kserve-56688d65f4-mvjdz" podUID="8768bc1c-ab77-4d40-9f39-94787e4e08f0" containerName="main" probeResult="failure" output="Get \"https://10.134.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 01:36:07.199627 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:07.199452    5640 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-1baf54/distinct-2-w1-1baf54-kserve-68c989c66-mjwjq" podUID="3042f316-58e3-4939-b9e9-bbf4396fa23d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 01:36:07.570950 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:07.570910    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3042f316-58e3-4939-b9e9-bbf4396fa23d" path="/var/lib/kubelet/pods/3042f316-58e3-4939-b9e9-bbf4396fa23d/volumes"
Nov 04 01:36:07.571581 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:07.571557    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8768bc1c-ab77-4d40-9f39-94787e4e08f0" path="/var/lib/kubelet/pods/8768bc1c-ab77-4d40-9f39-94787e4e08f0/volumes"
Nov 04 01:36:07.572174 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:07.572151    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ad652044-a765-43b7-b77d-d929324086de" path="/var/lib/kubelet/pods/ad652044-a765-43b7-b77d-d929324086de/volumes"
Nov 04 01:36:08.192356 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:08.192324    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:36:08.193139 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:08.193118    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:36:08.194623 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:08.194604    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:36:08.336981 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:08.336929    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:36:08.337350 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:08.337325    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:36:08.338336 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:08.338315    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:36:11.142414 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:36:11.142377    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:36:41.142776 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:36:41.142739    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:36:43.928460 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:43.928420    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"]
Nov 04 01:36:43.928955 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:43.928942    5640 cpu_manager.go:414] "containerMap: removing container" podUID="3042f316-58e3-4939-b9e9-bbf4396fa23d" containerName="main"
Nov 04 01:36:43.929040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:43.928956    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3042f316-58e3-4939-b9e9-bbf4396fa23d" containerName="main"
Nov 04 01:36:43.929040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:43.928986    5640 cpu_manager.go:414] "containerMap: removing container" podUID="ad652044-a765-43b7-b77d-d929324086de" containerName="main"
Nov 04 01:36:43.929040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:43.928992    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad652044-a765-43b7-b77d-d929324086de" containerName="main"
Nov 04 01:36:43.929040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:43.929026    5640 cpu_manager.go:414] "containerMap: removing container" podUID="8768bc1c-ab77-4d40-9f39-94787e4e08f0" containerName="main"
Nov 04 01:36:43.929040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:43.929032    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8768bc1c-ab77-4d40-9f39-94787e4e08f0" containerName="main"
Nov 04 01:36:43.929188 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:43.929118    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="8768bc1c-ab77-4d40-9f39-94787e4e08f0" containerName="main"
Nov 04 01:36:43.929188 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:43.929127    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="3042f316-58e3-4939-b9e9-bbf4396fa23d" containerName="main"
Nov 04 01:36:43.929188 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:43.929134    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="ad652044-a765-43b7-b77d-d929324086de" containerName="main"
Nov 04 01:36:43.932512 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:43.932495    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"
Nov 04 01:36:44.016676 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:44.016629    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9102582-6a31-4a75-af3d-07d643d55a02-maas-api-tls\") pod \"maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp\" (UID: \"a9102582-6a31-4a75-af3d-07d643d55a02\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"
Nov 04 01:36:44.016676 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:44.016677    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9102582-6a31-4a75-af3d-07d643d55a02-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp\" (UID: \"a9102582-6a31-4a75-af3d-07d643d55a02\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"
Nov 04 01:36:44.016944 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:44.016799    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg7x2\" (UniqueName: \"kubernetes.io/projected/a9102582-6a31-4a75-af3d-07d643d55a02-kube-api-access-hg7x2\") pod \"maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp\" (UID: \"a9102582-6a31-4a75-af3d-07d643d55a02\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"
Nov 04 01:36:44.016944 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:44.016865    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9102582-6a31-4a75-af3d-07d643d55a02-metrics-certs\") pod \"maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp\" (UID: \"a9102582-6a31-4a75-af3d-07d643d55a02\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"
Nov 04 01:36:44.046174 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:44.046143    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-extmod-b-1225f3-serving-cert\""
Nov 04 01:36:44.048999 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:44.048952    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"]
Nov 04 01:36:44.118085 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:44.118049    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9102582-6a31-4a75-af3d-07d643d55a02-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp\" (UID: \"a9102582-6a31-4a75-af3d-07d643d55a02\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"
Nov 04 01:36:44.118278 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:44.118114    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg7x2\" (UniqueName: \"kubernetes.io/projected/a9102582-6a31-4a75-af3d-07d643d55a02-kube-api-access-hg7x2\") pod \"maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp\" (UID: \"a9102582-6a31-4a75-af3d-07d643d55a02\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"
Nov 04 01:36:44.118278 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:44.118178    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9102582-6a31-4a75-af3d-07d643d55a02-metrics-certs\") pod \"maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp\" (UID: \"a9102582-6a31-4a75-af3d-07d643d55a02\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"
Nov 04 01:36:44.118278 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:44.118254    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9102582-6a31-4a75-af3d-07d643d55a02-maas-api-tls\") pod \"maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp\" (UID: \"a9102582-6a31-4a75-af3d-07d643d55a02\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"
Nov 04 01:36:44.118444 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:36:44.118345    5640 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-serving-cert: secret "maas-api-e2e-extmod-b-1225f3-serving-cert" not found
Nov 04 01:36:44.118444 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:36:44.118397    5640 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9102582-6a31-4a75-af3d-07d643d55a02-maas-api-tls podName:a9102582-6a31-4a75-af3d-07d643d55a02 nodeName:}" failed. No retries permitted until 2026-11-04 01:36:44.618382278 +0000 UTC m=+1527.170842382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a9102582-6a31-4a75-af3d-07d643d55a02-maas-api-tls") pod "maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp" (UID: "a9102582-6a31-4a75-af3d-07d643d55a02") : secret "maas-api-e2e-extmod-b-1225f3-serving-cert" not found
Nov 04 01:36:44.118740 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:44.118717    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9102582-6a31-4a75-af3d-07d643d55a02-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp\" (UID: \"a9102582-6a31-4a75-af3d-07d643d55a02\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"
Nov 04 01:36:44.120716 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:44.120692    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9102582-6a31-4a75-af3d-07d643d55a02-metrics-certs\") pod \"maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp\" (UID: \"a9102582-6a31-4a75-af3d-07d643d55a02\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"
Nov 04 01:36:44.181590 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:44.181520    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg7x2\" (UniqueName: \"kubernetes.io/projected/a9102582-6a31-4a75-af3d-07d643d55a02-kube-api-access-hg7x2\") pod \"maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp\" (UID: \"a9102582-6a31-4a75-af3d-07d643d55a02\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"
Nov 04 01:36:44.623943 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:44.623903    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9102582-6a31-4a75-af3d-07d643d55a02-maas-api-tls\") pod \"maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp\" (UID: \"a9102582-6a31-4a75-af3d-07d643d55a02\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"
Nov 04 01:36:44.626383 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:44.626355    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9102582-6a31-4a75-af3d-07d643d55a02-maas-api-tls\") pod \"maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp\" (UID: \"a9102582-6a31-4a75-af3d-07d643d55a02\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"
Nov 04 01:36:44.845871 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:44.845835    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"
Nov 04 01:36:45.228722 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:45.228697    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"]
Nov 04 01:36:45.229894 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:36:45.229866    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9102582_6a31_4a75_af3d_07d643d55a02.slice/crio-7322e2be08f03652aa2298db862be7b14f1f379cd883c9a5bc5794657e277d51 WatchSource:0}: Error finding container 7322e2be08f03652aa2298db862be7b14f1f379cd883c9a5bc5794657e277d51: Status 404 returned error can't find the container with id 7322e2be08f03652aa2298db862be7b14f1f379cd883c9a5bc5794657e277d51
Nov 04 01:36:45.917404 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:45.917361    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp" event={"ID":"a9102582-6a31-4a75-af3d-07d643d55a02","Type":"ContainerStarted","Data":"7322e2be08f03652aa2298db862be7b14f1f379cd883c9a5bc5794657e277d51"}
Nov 04 01:36:46.925188 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:46.925154    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp" event={"ID":"a9102582-6a31-4a75-af3d-07d643d55a02","Type":"ContainerStarted","Data":"a652a8358c64401645a60026a21a33a6c56a88588ad7bf4447200e436e3e9c90"}
Nov 04 01:36:46.925583 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:46.925212    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"
Nov 04 01:36:47.047394 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:47.047343    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp" podStartSLOduration=3.207988612 podStartE2EDuration="4.047329141s" totalImagesPullingTime="839.340529ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:36:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:36:47.046058393 +0000 UTC m=+1529.598518541" watchObservedRunningTime="2026-11-04 01:36:47.047329141 +0000 UTC m=+1529.599789297"
Nov 04 01:36:51.077115 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.077076    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"]
Nov 04 01:36:51.081275 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.081259    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:51.135428 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.135388    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Nov 04 01:36:51.135610 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.135524    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Nov 04 01:36:51.135610 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.135536    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Nov 04 01:36:51.135899 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.135881    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-b44fv\""
Nov 04 01:36:51.189783 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.189744    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"]
Nov 04 01:36:51.204313 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.204273    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2jpkz\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:51.204493 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.204326    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4dcd59b-b937-4fa4-a11c-23f2b746d724-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2jpkz\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:51.204562 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.204483    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2jpkz\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:51.204618 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.204588    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2jpkz\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:51.204689 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.204670    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c4dcd59b-b937-4fa4-a11c-23f2b746d724-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2jpkz\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:51.204748 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.204733    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxnsr\" (UniqueName: \"kubernetes.io/projected/c4dcd59b-b937-4fa4-a11c-23f2b746d724-kube-api-access-cxnsr\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2jpkz\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:51.204850 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.204830    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2jpkz\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:51.306554 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.306508    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2jpkz\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:51.306554 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.306570    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c4dcd59b-b937-4fa4-a11c-23f2b746d724-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2jpkz\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:51.306777 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.306610    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxnsr\" (UniqueName: \"kubernetes.io/projected/c4dcd59b-b937-4fa4-a11c-23f2b746d724-kube-api-access-cxnsr\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2jpkz\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:51.306777 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.306645    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2jpkz\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:51.306777 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.306732    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2jpkz\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:51.306777 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.306764    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4dcd59b-b937-4fa4-a11c-23f2b746d724-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2jpkz\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:51.306994 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.306839    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2jpkz\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:51.307601 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.307567    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2jpkz\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:51.309186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.309155    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2jpkz\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:51.309186 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.309171    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2jpkz\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:51.309336 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.309210    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c4dcd59b-b937-4fa4-a11c-23f2b746d724-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2jpkz\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:51.309336 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.309209    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4dcd59b-b937-4fa4-a11c-23f2b746d724-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2jpkz\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:51.369150 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.369093    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2jpkz\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:51.369484 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.369460    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxnsr\" (UniqueName: \"kubernetes.io/projected/c4dcd59b-b937-4fa4-a11c-23f2b746d724-kube-api-access-cxnsr\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2jpkz\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:51.394123 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.394104    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:51.828148 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.828123    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"]
Nov 04 01:36:51.828777 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:36:51.828751    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4dcd59b_b937_4fa4_a11c_23f2b746d724.slice/crio-223c98e96f2a30fe2489979063a5b2195f206a16b230db7e30426fee828c8a76 WatchSource:0}: Error finding container 223c98e96f2a30fe2489979063a5b2195f206a16b230db7e30426fee828c8a76: Status 404 returned error can't find the container with id 223c98e96f2a30fe2489979063a5b2195f206a16b230db7e30426fee828c8a76
Nov 04 01:36:51.831093 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.831061    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:36:51.831155 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.831126    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:36:51.954799 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.954767    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz" event={"ID":"c4dcd59b-b937-4fa4-a11c-23f2b746d724","Type":"ContainerStarted","Data":"241f67a06be9d20df73e435b7f10d92768916ecc0c746ca3f5132bbc4978fd1e"}
Nov 04 01:36:51.954984 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.954840    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz" event={"ID":"c4dcd59b-b937-4fa4-a11c-23f2b746d724","Type":"ContainerStarted","Data":"223c98e96f2a30fe2489979063a5b2195f206a16b230db7e30426fee828c8a76"}
Nov 04 01:36:51.954984 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:51.954963    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:52.086093 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:52.085992    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz" podStartSLOduration=1.085962784 podStartE2EDuration="1.085962784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:36:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:36:52.085047587 +0000 UTC m=+1534.637507733" watchObservedRunningTime="2026-11-04 01:36:52.085962784 +0000 UTC m=+1534.638422910"
Nov 04 01:36:52.936019 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:52.935954    5640 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp" podUID="a9102582-6a31-4a75-af3d-07d643d55a02" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.72:8443/health\": dial tcp 10.134.0.72:8443: connect: connection refused"
Nov 04 01:36:52.962419 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:52.962385    5640 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-2jpkz container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 01:36:52.962558 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:52.962435    5640 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz" podUID="c4dcd59b-b937-4fa4-a11c-23f2b746d724" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 01:36:55.087452 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:55.087420    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst"]
Nov 04 01:36:55.961681 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:55.961656    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:36:56.984205 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:56.984174    5640 generic.go:356] "Generic (PLEG): container finished" podID="a9102582-6a31-4a75-af3d-07d643d55a02" containerID="a652a8358c64401645a60026a21a33a6c56a88588ad7bf4447200e436e3e9c90" exitCode=1
Nov 04 01:36:56.984586 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:56.984249    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp" event={"ID":"a9102582-6a31-4a75-af3d-07d643d55a02","Type":"ContainerDied","Data":"a652a8358c64401645a60026a21a33a6c56a88588ad7bf4447200e436e3e9c90"}
Nov 04 01:36:56.984628 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:56.984591    5640 scope.go:122] "RemoveContainer" containerID="a652a8358c64401645a60026a21a33a6c56a88588ad7bf4447200e436e3e9c90"
Nov 04 01:36:57.991827 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:57.991799    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp" event={"ID":"a9102582-6a31-4a75-af3d-07d643d55a02","Type":"ContainerStarted","Data":"696b9aa325fce4c219170039384b104bf4d262d4e5e225038adab8c08d67a44b"}
Nov 04 01:36:57.992209 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:57.992022    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"
Nov 04 01:36:59.202652 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:59.202621    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"]
Nov 04 01:36:59.203079 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:59.202856    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc" podUID="96ccdcef-08b4-4c72-b50b-be349fadb0b0" containerName="maas-api" containerID="cri-o://b1c9e18e79a867c0c55ceb7e667cdd2be444ae5e0d111a6065a46edc938e2ac9" gracePeriod=30
Nov 04 01:36:59.471759 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:59.471694    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"
Nov 04 01:36:59.502621 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:59.502596    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/96ccdcef-08b4-4c72-b50b-be349fadb0b0-kube-api-access-t226s\" (UniqueName: \"kubernetes.io/projected/96ccdcef-08b4-4c72-b50b-be349fadb0b0-kube-api-access-t226s\") pod \"96ccdcef-08b4-4c72-b50b-be349fadb0b0\" (UID: \"96ccdcef-08b4-4c72-b50b-be349fadb0b0\") "
Nov 04 01:36:59.502789 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:59.502717    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/96ccdcef-08b4-4c72-b50b-be349fadb0b0-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96ccdcef-08b4-4c72-b50b-be349fadb0b0-openshift-service-ca\") pod \"96ccdcef-08b4-4c72-b50b-be349fadb0b0\" (UID: \"96ccdcef-08b4-4c72-b50b-be349fadb0b0\") "
Nov 04 01:36:59.502789 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:59.502765    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96ccdcef-08b4-4c72-b50b-be349fadb0b0-metrics-certs\" (UniqueName: \"kubernetes.io/secret/96ccdcef-08b4-4c72-b50b-be349fadb0b0-metrics-certs\") pod \"96ccdcef-08b4-4c72-b50b-be349fadb0b0\" (UID: \"96ccdcef-08b4-4c72-b50b-be349fadb0b0\") "
Nov 04 01:36:59.502919 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:59.502833    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96ccdcef-08b4-4c72-b50b-be349fadb0b0-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96ccdcef-08b4-4c72-b50b-be349fadb0b0-maas-api-tls\") pod \"96ccdcef-08b4-4c72-b50b-be349fadb0b0\" (UID: \"96ccdcef-08b4-4c72-b50b-be349fadb0b0\") "
Nov 04 01:36:59.503169 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:59.503140    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96ccdcef-08b4-4c72-b50b-be349fadb0b0-openshift-service-ca" pod "96ccdcef-08b4-4c72-b50b-be349fadb0b0" (UID: "96ccdcef-08b4-4c72-b50b-be349fadb0b0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:36:59.503374 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:59.503358    5640 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96ccdcef-08b4-4c72-b50b-be349fadb0b0-openshift-service-ca\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:59.504939 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:59.504907    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96ccdcef-08b4-4c72-b50b-be349fadb0b0-metrics-certs" pod "96ccdcef-08b4-4c72-b50b-be349fadb0b0" (UID: "96ccdcef-08b4-4c72-b50b-be349fadb0b0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:36:59.505058 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:59.505031    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96ccdcef-08b4-4c72-b50b-be349fadb0b0-maas-api-tls" pod "96ccdcef-08b4-4c72-b50b-be349fadb0b0" (UID: "96ccdcef-08b4-4c72-b50b-be349fadb0b0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:36:59.505058 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:59.505027    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96ccdcef-08b4-4c72-b50b-be349fadb0b0-kube-api-access-t226s" pod "96ccdcef-08b4-4c72-b50b-be349fadb0b0" (UID: "96ccdcef-08b4-4c72-b50b-be349fadb0b0"). InnerVolumeSpecName "kube-api-access-t226s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:36:59.604620 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:59.604593    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t226s\" (UniqueName: \"kubernetes.io/projected/96ccdcef-08b4-4c72-b50b-be349fadb0b0-kube-api-access-t226s\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:59.604620 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:59.604620    5640 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96ccdcef-08b4-4c72-b50b-be349fadb0b0-metrics-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:59.604777 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:36:59.604630    5640 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96ccdcef-08b4-4c72-b50b-be349fadb0b0-maas-api-tls\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:00.005280 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:00.005241    5640 generic.go:356] "Generic (PLEG): container finished" podID="96ccdcef-08b4-4c72-b50b-be349fadb0b0" containerID="b1c9e18e79a867c0c55ceb7e667cdd2be444ae5e0d111a6065a46edc938e2ac9" exitCode=0
Nov 04 01:37:00.005480 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:00.005284    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"
Nov 04 01:37:00.005480 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:00.005326    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc" event={"ID":"96ccdcef-08b4-4c72-b50b-be349fadb0b0","Type":"ContainerDied","Data":"b1c9e18e79a867c0c55ceb7e667cdd2be444ae5e0d111a6065a46edc938e2ac9"}
Nov 04 01:37:00.005480 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:00.005389    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc" event={"ID":"96ccdcef-08b4-4c72-b50b-be349fadb0b0","Type":"ContainerDied","Data":"a2385a12add0db9033284df8d7b225639501bc3bd0639ece72c1c69a2e7f9015"}
Nov 04 01:37:00.005480 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:00.005419    5640 scope.go:122] "RemoveContainer" containerID="b1c9e18e79a867c0c55ceb7e667cdd2be444ae5e0d111a6065a46edc938e2ac9"
Nov 04 01:37:00.014919 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:00.014904    5640 scope.go:122] "RemoveContainer" containerID="b1c9e18e79a867c0c55ceb7e667cdd2be444ae5e0d111a6065a46edc938e2ac9"
Nov 04 01:37:00.015211 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:37:00.015193    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1c9e18e79a867c0c55ceb7e667cdd2be444ae5e0d111a6065a46edc938e2ac9\": container with ID starting with b1c9e18e79a867c0c55ceb7e667cdd2be444ae5e0d111a6065a46edc938e2ac9 not found: ID does not exist" containerID="b1c9e18e79a867c0c55ceb7e667cdd2be444ae5e0d111a6065a46edc938e2ac9"
Nov 04 01:37:00.015264 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:00.015218    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1c9e18e79a867c0c55ceb7e667cdd2be444ae5e0d111a6065a46edc938e2ac9"} err="failed to get container status \"b1c9e18e79a867c0c55ceb7e667cdd2be444ae5e0d111a6065a46edc938e2ac9\": rpc error: code = NotFound desc = could not find container \"b1c9e18e79a867c0c55ceb7e667cdd2be444ae5e0d111a6065a46edc938e2ac9\": container with ID starting with b1c9e18e79a867c0c55ceb7e667cdd2be444ae5e0d111a6065a46edc938e2ac9 not found: ID does not exist"
Nov 04 01:37:00.088409 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:00.088385    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst" podUID="7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8" containerName="payload-processing" containerID="cri-o://8165e8b7d40cea6c7741f178bc7d7768f3383602025c079ff90e3a5f776cb7f4" gracePeriod=25
Nov 04 01:37:00.174604 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:00.174579    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"]
Nov 04 01:37:00.226358 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:00.226333    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-1baf54-555cd89c45-p7tkc"]
Nov 04 01:37:00.367067 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:00.367044    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst"
Nov 04 01:37:00.414475 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:00.414447    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8-kube-api-access-zn5ts\" (UniqueName: \"kubernetes.io/projected/7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8-kube-api-access-zn5ts\") pod \"7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8\" (UID: \"7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8\") "
Nov 04 01:37:00.414647 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:00.414509    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8-plugins-config-volume\") pod \"7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8\" (UID: \"7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8\") "
Nov 04 01:37:00.414957 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:00.414932    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8-plugins-config-volume" pod "7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8" (UID: "7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:37:00.415137 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:00.415119    5640 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8-plugins-config-volume\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:00.416711 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:00.416688    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8-kube-api-access-zn5ts" pod "7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8" (UID: "7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8"). InnerVolumeSpecName "kube-api-access-zn5ts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:37:00.516426 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:00.516335    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zn5ts\" (UniqueName: \"kubernetes.io/projected/7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8-kube-api-access-zn5ts\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:01.013787 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:01.013751    5640 generic.go:356] "Generic (PLEG): container finished" podID="7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8" containerID="8165e8b7d40cea6c7741f178bc7d7768f3383602025c079ff90e3a5f776cb7f4" exitCode=0
Nov 04 01:37:01.013981 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:01.013815    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst"
Nov 04 01:37:01.014078 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:01.013959    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst" event={"ID":"7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8","Type":"ContainerDied","Data":"8165e8b7d40cea6c7741f178bc7d7768f3383602025c079ff90e3a5f776cb7f4"}
Nov 04 01:37:01.014078 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:01.014019    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst" event={"ID":"7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8","Type":"ContainerDied","Data":"4f0be1ca8d077ad989266e45be181887c97fab6b5bcb0d12cb630ec50b38558e"}
Nov 04 01:37:01.014078 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:01.014042    5640 scope.go:122] "RemoveContainer" containerID="8165e8b7d40cea6c7741f178bc7d7768f3383602025c079ff90e3a5f776cb7f4"
Nov 04 01:37:01.027579 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:01.027563    5640 scope.go:122] "RemoveContainer" containerID="8165e8b7d40cea6c7741f178bc7d7768f3383602025c079ff90e3a5f776cb7f4"
Nov 04 01:37:01.027888 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:37:01.027868    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8165e8b7d40cea6c7741f178bc7d7768f3383602025c079ff90e3a5f776cb7f4\": container with ID starting with 8165e8b7d40cea6c7741f178bc7d7768f3383602025c079ff90e3a5f776cb7f4 not found: ID does not exist" containerID="8165e8b7d40cea6c7741f178bc7d7768f3383602025c079ff90e3a5f776cb7f4"
Nov 04 01:37:01.027964 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:01.027898    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8165e8b7d40cea6c7741f178bc7d7768f3383602025c079ff90e3a5f776cb7f4"} err="failed to get container status \"8165e8b7d40cea6c7741f178bc7d7768f3383602025c079ff90e3a5f776cb7f4\": rpc error: code = NotFound desc = could not find container \"8165e8b7d40cea6c7741f178bc7d7768f3383602025c079ff90e3a5f776cb7f4\": container with ID starting with 8165e8b7d40cea6c7741f178bc7d7768f3383602025c079ff90e3a5f776cb7f4 not found: ID does not exist"
Nov 04 01:37:01.189283 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:01.189244    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst"]
Nov 04 01:37:01.240600 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:01.240561    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-cae0ab-66775db5db-j4xst"]
Nov 04 01:37:01.566487 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:01.566454    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8" path="/var/lib/kubelet/pods/7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8/volumes"
Nov 04 01:37:01.566997 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:01.566964    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="96ccdcef-08b4-4c72-b50b-be349fadb0b0" path="/var/lib/kubelet/pods/96ccdcef-08b4-4c72-b50b-be349fadb0b0/volumes"
Nov 04 01:37:04.004027 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:04.004001    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"
Nov 04 01:37:09.442934 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:09.442905    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"]
Nov 04 01:37:09.443342 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:09.443158    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978" podUID="e678048d-06f8-4101-85e2-b0c5d125238a" containerName="istio-proxy" containerID="cri-o://8bec9603521caa39826b22695bdf1c0aae167d57716102432b17a9a9a43ac9e9" gracePeriod=30
Nov 04 01:37:11.135491 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:11.135403    5640 generic.go:356] "Generic (PLEG): container finished" podID="31772fc6-bc9a-4d40-a587-914fffa131a6" containerID="3913e217e7f3d33bd23f79ce441b4af894c6342559f8eccb5b105b7bb8408e44" exitCode=0
Nov 04 01:37:11.135491 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:11.135471    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh" event={"ID":"31772fc6-bc9a-4d40-a587-914fffa131a6","Type":"ContainerDied","Data":"3913e217e7f3d33bd23f79ce441b4af894c6342559f8eccb5b105b7bb8408e44"}
Nov 04 01:37:11.136002 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:11.135846    5640 scope.go:122] "RemoveContainer" containerID="3913e217e7f3d33bd23f79ce441b4af894c6342559f8eccb5b105b7bb8408e44"
Nov 04 01:37:11.137465 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:11.137431    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:37:11.137541 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:11.137513    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:37:11.137578 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:11.137547    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:37:11.148812 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:37:11.148776    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:37:12.166950 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:12.166914    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh" event={"ID":"31772fc6-bc9a-4d40-a587-914fffa131a6","Type":"ContainerStarted","Data":"7f769d7e510ea7a6fd18635d551c73e400f2c3c802fff39e7ae799f826b0cfa4"}
Nov 04 01:37:12.637011 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:12.636958    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:37:12.638479 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:12.638452    5640 patch_prober.go:29] interesting pod/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Nov 04 01:37:12.638599 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:12.638505    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh" podUID="31772fc6-bc9a-4d40-a587-914fffa131a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Nov 04 01:37:13.637312 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:13.637278    5640 patch_prober.go:29] interesting pod/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Nov 04 01:37:13.637794 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:13.637334    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh" podUID="31772fc6-bc9a-4d40-a587-914fffa131a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Nov 04 01:37:14.637867 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.637836    5640 patch_prober.go:29] interesting pod/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Nov 04 01:37:14.638227 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.637881    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh" podUID="31772fc6-bc9a-4d40-a587-914fffa131a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Nov 04 01:37:14.737833 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.737774    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:37:14.809140 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.809101    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-workload-socket\") pod \"e678048d-06f8-4101-85e2-b0c5d125238a\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") "
Nov 04 01:37:14.809484 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.809464    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-credential-socket\") pod \"e678048d-06f8-4101-85e2-b0c5d125238a\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") "
Nov 04 01:37:14.809604 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.809589    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e678048d-06f8-4101-85e2-b0c5d125238a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e678048d-06f8-4101-85e2-b0c5d125238a-istio-podinfo\") pod \"e678048d-06f8-4101-85e2-b0c5d125238a\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") "
Nov 04 01:37:14.809742 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.809726    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-istio-data\") pod \"e678048d-06f8-4101-85e2-b0c5d125238a\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") "
Nov 04 01:37:14.809908 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.809891    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e678048d-06f8-4101-85e2-b0c5d125238a-istio-token\" (UniqueName: \"kubernetes.io/projected/e678048d-06f8-4101-85e2-b0c5d125238a-istio-token\") pod \"e678048d-06f8-4101-85e2-b0c5d125238a\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") "
Nov 04 01:37:14.816661 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.816640    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-workload-certs\") pod \"e678048d-06f8-4101-85e2-b0c5d125238a\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") "
Nov 04 01:37:14.816862 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.816845    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e678048d-06f8-4101-85e2-b0c5d125238a-kube-api-access-tlb7g\" (UniqueName: \"kubernetes.io/projected/e678048d-06f8-4101-85e2-b0c5d125238a-kube-api-access-tlb7g\") pod \"e678048d-06f8-4101-85e2-b0c5d125238a\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") "
Nov 04 01:37:14.828605 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.810092    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-workload-socket" pod "e678048d-06f8-4101-85e2-b0c5d125238a" (UID: "e678048d-06f8-4101-85e2-b0c5d125238a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:37:14.828605 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.810685    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-credential-socket" pod "e678048d-06f8-4101-85e2-b0c5d125238a" (UID: "e678048d-06f8-4101-85e2-b0c5d125238a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:37:14.828605 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.818247    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-workload-certs" pod "e678048d-06f8-4101-85e2-b0c5d125238a" (UID: "e678048d-06f8-4101-85e2-b0c5d125238a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:37:14.828605 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.821816    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-istio-data" pod "e678048d-06f8-4101-85e2-b0c5d125238a" (UID: "e678048d-06f8-4101-85e2-b0c5d125238a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:37:14.828605 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.822003    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-istio-envoy\") pod \"e678048d-06f8-4101-85e2-b0c5d125238a\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") "
Nov 04 01:37:14.828605 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.822053    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e678048d-06f8-4101-85e2-b0c5d125238a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e678048d-06f8-4101-85e2-b0c5d125238a-istiod-ca-cert\") pod \"e678048d-06f8-4101-85e2-b0c5d125238a\" (UID: \"e678048d-06f8-4101-85e2-b0c5d125238a\") "
Nov 04 01:37:14.828605 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.822588    5640 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-workload-socket\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:14.828605 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.822608    5640 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-credential-socket\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:14.828605 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.822623    5640 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-istio-data\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:14.828605 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.822636    5640 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-workload-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:14.828605 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.822985    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e678048d-06f8-4101-85e2-b0c5d125238a-istiod-ca-cert" pod "e678048d-06f8-4101-85e2-b0c5d125238a" (UID: "e678048d-06f8-4101-85e2-b0c5d125238a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:37:14.828605 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.826217    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e678048d-06f8-4101-85e2-b0c5d125238a-istio-podinfo" pod "e678048d-06f8-4101-85e2-b0c5d125238a" (UID: "e678048d-06f8-4101-85e2-b0c5d125238a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 01:37:14.828605 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.827068    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e678048d-06f8-4101-85e2-b0c5d125238a-istio-token" pod "e678048d-06f8-4101-85e2-b0c5d125238a" (UID: "e678048d-06f8-4101-85e2-b0c5d125238a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:37:14.828605 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.827370    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e678048d-06f8-4101-85e2-b0c5d125238a-kube-api-access-tlb7g" pod "e678048d-06f8-4101-85e2-b0c5d125238a" (UID: "e678048d-06f8-4101-85e2-b0c5d125238a"). InnerVolumeSpecName "kube-api-access-tlb7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:37:14.828605 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.828143    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-istio-envoy" pod "e678048d-06f8-4101-85e2-b0c5d125238a" (UID: "e678048d-06f8-4101-85e2-b0c5d125238a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:37:14.923489 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.923460    5640 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e678048d-06f8-4101-85e2-b0c5d125238a-istio-podinfo\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:14.923489 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.923484    5640 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e678048d-06f8-4101-85e2-b0c5d125238a-istio-token\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:14.923489 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.923495    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlb7g\" (UniqueName: \"kubernetes.io/projected/e678048d-06f8-4101-85e2-b0c5d125238a-kube-api-access-tlb7g\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:14.923797 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.923505    5640 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e678048d-06f8-4101-85e2-b0c5d125238a-istio-envoy\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:14.923797 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:14.923514    5640 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e678048d-06f8-4101-85e2-b0c5d125238a-istiod-ca-cert\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:15.194744 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:15.194704    5640 generic.go:356] "Generic (PLEG): container finished" podID="e678048d-06f8-4101-85e2-b0c5d125238a" containerID="8bec9603521caa39826b22695bdf1c0aae167d57716102432b17a9a9a43ac9e9" exitCode=0
Nov 04 01:37:15.194947 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:15.194802    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978" event={"ID":"e678048d-06f8-4101-85e2-b0c5d125238a","Type":"ContainerDied","Data":"8bec9603521caa39826b22695bdf1c0aae167d57716102432b17a9a9a43ac9e9"}
Nov 04 01:37:15.194947 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:15.194898    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978" event={"ID":"e678048d-06f8-4101-85e2-b0c5d125238a","Type":"ContainerDied","Data":"2429ac9c1e5ff39f9d11b454839a18c57d1f0815ff52006dfe95e4ac592c8565"}
Nov 04 01:37:15.194947 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:15.194937    5640 scope.go:122] "RemoveContainer" containerID="8bec9603521caa39826b22695bdf1c0aae167d57716102432b17a9a9a43ac9e9"
Nov 04 01:37:15.195426 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:15.195406    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"
Nov 04 01:37:15.205003 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:15.204953    5640 scope.go:122] "RemoveContainer" containerID="3357eb8596482ff47260ceedd79ebe50ad3b9ab7cd287693d454a1f201ebb234"
Nov 04 01:37:15.214337 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:15.214317    5640 scope.go:122] "RemoveContainer" containerID="8bec9603521caa39826b22695bdf1c0aae167d57716102432b17a9a9a43ac9e9"
Nov 04 01:37:15.214580 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:37:15.214563    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bec9603521caa39826b22695bdf1c0aae167d57716102432b17a9a9a43ac9e9\": container with ID starting with 8bec9603521caa39826b22695bdf1c0aae167d57716102432b17a9a9a43ac9e9 not found: ID does not exist" containerID="8bec9603521caa39826b22695bdf1c0aae167d57716102432b17a9a9a43ac9e9"
Nov 04 01:37:15.214632 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:15.214587    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bec9603521caa39826b22695bdf1c0aae167d57716102432b17a9a9a43ac9e9"} err="failed to get container status \"8bec9603521caa39826b22695bdf1c0aae167d57716102432b17a9a9a43ac9e9\": rpc error: code = NotFound desc = could not find container \"8bec9603521caa39826b22695bdf1c0aae167d57716102432b17a9a9a43ac9e9\": container with ID starting with 8bec9603521caa39826b22695bdf1c0aae167d57716102432b17a9a9a43ac9e9 not found: ID does not exist"
Nov 04 01:37:15.214632 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:15.214603    5640 scope.go:122] "RemoveContainer" containerID="3357eb8596482ff47260ceedd79ebe50ad3b9ab7cd287693d454a1f201ebb234"
Nov 04 01:37:15.214823 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:37:15.214800    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3357eb8596482ff47260ceedd79ebe50ad3b9ab7cd287693d454a1f201ebb234\": container with ID starting with 3357eb8596482ff47260ceedd79ebe50ad3b9ab7cd287693d454a1f201ebb234 not found: ID does not exist" containerID="3357eb8596482ff47260ceedd79ebe50ad3b9ab7cd287693d454a1f201ebb234"
Nov 04 01:37:15.214863 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:15.214824    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3357eb8596482ff47260ceedd79ebe50ad3b9ab7cd287693d454a1f201ebb234"} err="failed to get container status \"3357eb8596482ff47260ceedd79ebe50ad3b9ab7cd287693d454a1f201ebb234\": rpc error: code = NotFound desc = could not find container \"3357eb8596482ff47260ceedd79ebe50ad3b9ab7cd287693d454a1f201ebb234\": container with ID starting with 3357eb8596482ff47260ceedd79ebe50ad3b9ab7cd287693d454a1f201ebb234 not found: ID does not exist"
Nov 04 01:37:15.364993 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:15.364730    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:37:15.385791 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:15.385763    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"]
Nov 04 01:37:15.398776 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:15.398749    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978"]
Nov 04 01:37:15.576098 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:15.576059    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e678048d-06f8-4101-85e2-b0c5d125238a" path="/var/lib/kubelet/pods/e678048d-06f8-4101-85e2-b0c5d125238a/volumes"
Nov 04 01:37:15.637132 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:15.637099    5640 patch_prober.go:29] interesting pod/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Nov 04 01:37:15.637298 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:15.637148    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh" podUID="31772fc6-bc9a-4d40-a587-914fffa131a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Nov 04 01:37:15.716766 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:15.716734    5640 patch_prober.go:29] interesting pod/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 01:37:15.717258 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:15.716795    5640 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-f9978" podUID="e678048d-06f8-4101-85e2-b0c5d125238a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 01:37:16.637763 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:16.637729    5640 patch_prober.go:29] interesting pod/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Nov 04 01:37:16.637940 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:16.637785    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh" podUID="31772fc6-bc9a-4d40-a587-914fffa131a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Nov 04 01:37:17.641142 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:17.641113    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:37:17.642149 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:17.642131    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:37:23.273207 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:23.273175    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"]
Nov 04 01:37:31.276685 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:31.276648    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt"]
Nov 04 01:37:36.278203 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:36.278163    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt" podUID="ad129c82-d850-4d18-97cc-707534ab121a" containerName="payload-pre-processing" containerID="cri-o://81c2229c6a17f3600e569499a69f1bab3b10d077eac805103bc08da1d62a2fc2" gracePeriod=25
Nov 04 01:37:38.294311 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:38.294271    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm" podUID="1f451fd0-3f5b-464e-8e0a-c308fb4be072" containerName="main" containerID="cri-o://e2d7eb0e062c5fc81d445ddd7dd2b016faf4f6de4bedf9c5c5cf324b145d4abc" gracePeriod=45
Nov 04 01:37:38.553911 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:38.553850    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:37:38.621283 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:38.621243    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-home\" (UniqueName: \"kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-home\") pod \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\" (UID: \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\") "
Nov 04 01:37:38.621462 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:38.621308    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1f451fd0-3f5b-464e-8e0a-c308fb4be072-kube-api-access-xxf8h\" (UniqueName: \"kubernetes.io/projected/1f451fd0-3f5b-464e-8e0a-c308fb4be072-kube-api-access-xxf8h\") pod \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\" (UID: \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\") "
Nov 04 01:37:38.621462 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:38.621350    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-dshm\") pod \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\" (UID: \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\") "
Nov 04 01:37:38.621462 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:38.621393    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-model-cache\") pod \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\" (UID: \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\") "
Nov 04 01:37:38.621646 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:38.621499    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1f451fd0-3f5b-464e-8e0a-c308fb4be072-tls-certs\" (UniqueName: \"kubernetes.io/secret/1f451fd0-3f5b-464e-8e0a-c308fb4be072-tls-certs\") pod \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\" (UID: \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\") "
Nov 04 01:37:38.621646 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:38.621523    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-tmp-dir\") pod \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\" (UID: \"1f451fd0-3f5b-464e-8e0a-c308fb4be072\") "
Nov 04 01:37:38.621646 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:38.621572    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-home" pod "1f451fd0-3f5b-464e-8e0a-c308fb4be072" (UID: "1f451fd0-3f5b-464e-8e0a-c308fb4be072"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:37:38.621801 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:38.621753    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-model-cache" pod "1f451fd0-3f5b-464e-8e0a-c308fb4be072" (UID: "1f451fd0-3f5b-464e-8e0a-c308fb4be072"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:37:38.621897 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:38.621873    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-tmp-dir" pod "1f451fd0-3f5b-464e-8e0a-c308fb4be072" (UID: "1f451fd0-3f5b-464e-8e0a-c308fb4be072"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:37:38.622178 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:38.622151    5640 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-tmp-dir\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:38.622178 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:38.622179    5640 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-home\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:38.622391 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:38.622193    5640 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-model-cache\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:38.623802 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:38.623778    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f451fd0-3f5b-464e-8e0a-c308fb4be072-tls-certs" pod "1f451fd0-3f5b-464e-8e0a-c308fb4be072" (UID: "1f451fd0-3f5b-464e-8e0a-c308fb4be072"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:37:38.623802 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:38.623775    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f451fd0-3f5b-464e-8e0a-c308fb4be072-kube-api-access-xxf8h" pod "1f451fd0-3f5b-464e-8e0a-c308fb4be072" (UID: "1f451fd0-3f5b-464e-8e0a-c308fb4be072"). InnerVolumeSpecName "kube-api-access-xxf8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:37:38.623980 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:38.623815    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-dshm" pod "1f451fd0-3f5b-464e-8e0a-c308fb4be072" (UID: "1f451fd0-3f5b-464e-8e0a-c308fb4be072"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:37:38.723585 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:38.723548    5640 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f451fd0-3f5b-464e-8e0a-c308fb4be072-dshm\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:38.723585 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:38.723579    5640 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f451fd0-3f5b-464e-8e0a-c308fb4be072-tls-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:38.723771 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:38.723595    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxf8h\" (UniqueName: \"kubernetes.io/projected/1f451fd0-3f5b-464e-8e0a-c308fb4be072-kube-api-access-xxf8h\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:39.339744 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:39.339713    5640 generic.go:356] "Generic (PLEG): container finished" podID="1f451fd0-3f5b-464e-8e0a-c308fb4be072" containerID="e2d7eb0e062c5fc81d445ddd7dd2b016faf4f6de4bedf9c5c5cf324b145d4abc" exitCode=0
Nov 04 01:37:39.340180 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:39.339772    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"
Nov 04 01:37:39.340180 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:39.339780    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm" event={"ID":"1f451fd0-3f5b-464e-8e0a-c308fb4be072","Type":"ContainerDied","Data":"e2d7eb0e062c5fc81d445ddd7dd2b016faf4f6de4bedf9c5c5cf324b145d4abc"}
Nov 04 01:37:39.340180 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:39.339825    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm" event={"ID":"1f451fd0-3f5b-464e-8e0a-c308fb4be072","Type":"ContainerDied","Data":"cac44bc99e86db36581db6063d23fe68276cc64a9e4ffff027564522f2c96be3"}
Nov 04 01:37:39.340180 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:39.339844    5640 scope.go:122] "RemoveContainer" containerID="e2d7eb0e062c5fc81d445ddd7dd2b016faf4f6de4bedf9c5c5cf324b145d4abc"
Nov 04 01:37:39.350130 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:39.350113    5640 scope.go:122] "RemoveContainer" containerID="e2d7eb0e062c5fc81d445ddd7dd2b016faf4f6de4bedf9c5c5cf324b145d4abc"
Nov 04 01:37:39.350424 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:37:39.350405    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2d7eb0e062c5fc81d445ddd7dd2b016faf4f6de4bedf9c5c5cf324b145d4abc\": container with ID starting with e2d7eb0e062c5fc81d445ddd7dd2b016faf4f6de4bedf9c5c5cf324b145d4abc not found: ID does not exist" containerID="e2d7eb0e062c5fc81d445ddd7dd2b016faf4f6de4bedf9c5c5cf324b145d4abc"
Nov 04 01:37:39.350525 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:39.350430    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2d7eb0e062c5fc81d445ddd7dd2b016faf4f6de4bedf9c5c5cf324b145d4abc"} err="failed to get container status \"e2d7eb0e062c5fc81d445ddd7dd2b016faf4f6de4bedf9c5c5cf324b145d4abc\": rpc error: code = NotFound desc = could not find container \"e2d7eb0e062c5fc81d445ddd7dd2b016faf4f6de4bedf9c5c5cf324b145d4abc\": container with ID starting with e2d7eb0e062c5fc81d445ddd7dd2b016faf4f6de4bedf9c5c5cf324b145d4abc not found: ID does not exist"
Nov 04 01:37:39.509444 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:39.509397    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"]
Nov 04 01:37:39.567193 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:39.567163    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-9f7183/premium-w3-9f7183-kserve-57f4d8db8f-lwkbm"]
Nov 04 01:37:41.139476 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:41.139436    5640 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt" podUID="ad129c82-d850-4d18-97cc-707534ab121a" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 01:37:41.141712 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:37:41.141676    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:37:41.565843 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:41.565814    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1f451fd0-3f5b-464e-8e0a-c308fb4be072" path="/var/lib/kubelet/pods/1f451fd0-3f5b-464e-8e0a-c308fb4be072/volumes"
Nov 04 01:37:51.140133 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:51.140094    5640 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt" podUID="ad129c82-d850-4d18-97cc-707534ab121a" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 01:37:56.438830 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:56.438782    5640 generic.go:356] "Generic (PLEG): container finished" podID="ad129c82-d850-4d18-97cc-707534ab121a" containerID="81c2229c6a17f3600e569499a69f1bab3b10d077eac805103bc08da1d62a2fc2" exitCode=0
Nov 04 01:37:56.439219 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:56.438845    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt" event={"ID":"ad129c82-d850-4d18-97cc-707534ab121a","Type":"ContainerDied","Data":"81c2229c6a17f3600e569499a69f1bab3b10d077eac805103bc08da1d62a2fc2"}
Nov 04 01:37:56.550601 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:56.550531    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt"
Nov 04 01:37:56.738696 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:56.738654    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad129c82-d850-4d18-97cc-707534ab121a-kube-api-access-hldwq\" (UniqueName: \"kubernetes.io/projected/ad129c82-d850-4d18-97cc-707534ab121a-kube-api-access-hldwq\") pod \"ad129c82-d850-4d18-97cc-707534ab121a\" (UID: \"ad129c82-d850-4d18-97cc-707534ab121a\") "
Nov 04 01:37:56.738887 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:56.738838    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ad129c82-d850-4d18-97cc-707534ab121a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad129c82-d850-4d18-97cc-707534ab121a-plugins-config-volume\") pod \"ad129c82-d850-4d18-97cc-707534ab121a\" (UID: \"ad129c82-d850-4d18-97cc-707534ab121a\") "
Nov 04 01:37:56.739306 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:56.739275    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad129c82-d850-4d18-97cc-707534ab121a-plugins-config-volume" pod "ad129c82-d850-4d18-97cc-707534ab121a" (UID: "ad129c82-d850-4d18-97cc-707534ab121a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:37:56.739785 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:56.739758    5640 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad129c82-d850-4d18-97cc-707534ab121a-plugins-config-volume\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:56.741136 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:56.741113    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad129c82-d850-4d18-97cc-707534ab121a-kube-api-access-hldwq" pod "ad129c82-d850-4d18-97cc-707534ab121a" (UID: "ad129c82-d850-4d18-97cc-707534ab121a"). InnerVolumeSpecName "kube-api-access-hldwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:37:56.841393 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:56.841307    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hldwq\" (UniqueName: \"kubernetes.io/projected/ad129c82-d850-4d18-97cc-707534ab121a-kube-api-access-hldwq\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:57.446271 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:57.446239    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt"
Nov 04 01:37:57.446271 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:57.446258    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt" event={"ID":"ad129c82-d850-4d18-97cc-707534ab121a","Type":"ContainerDied","Data":"e769154269f26b4812da3f73146334d0ba5900ee6e429d2f4153cb43df150410"}
Nov 04 01:37:57.446775 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:57.446344    5640 scope.go:122] "RemoveContainer" containerID="81c2229c6a17f3600e569499a69f1bab3b10d077eac805103bc08da1d62a2fc2"
Nov 04 01:37:57.616212 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:57.616183    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt"]
Nov 04 01:37:57.667652 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:57.667622    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-9f7183-764969574c-pj9mt"]
Nov 04 01:37:59.565013 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:37:59.564957    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ad129c82-d850-4d18-97cc-707534ab121a" path="/var/lib/kubelet/pods/ad129c82-d850-4d18-97cc-707534ab121a/volumes"
Nov 04 01:38:11.143411 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:38:11.143370    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:38:20.018366 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.018334    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"]
Nov 04 01:38:20.018837 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.018540    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78" podUID="abfac0e2-8f66-48b7-a64d-0f9a86f206a5" containerName="maas-api" containerID="cri-o://2d74cf4c7183ddf93c67d33ae71538f06034add47669c9f11ed4ec195962bb2d" gracePeriod=30
Nov 04 01:38:20.160044 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.160003    5640 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78" podUID="abfac0e2-8f66-48b7-a64d-0f9a86f206a5" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.46:8443/health\": dial tcp 10.134.0.46:8443: connect: connection refused"
Nov 04 01:38:20.288331 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.288305    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"
Nov 04 01:38:20.395212 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.395182    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-metrics-certs\" (UniqueName: \"kubernetes.io/secret/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-metrics-certs\") pod \"abfac0e2-8f66-48b7-a64d-0f9a86f206a5\" (UID: \"abfac0e2-8f66-48b7-a64d-0f9a86f206a5\") "
Nov 04 01:38:20.395412 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.395236    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-maas-api-tls\") pod \"abfac0e2-8f66-48b7-a64d-0f9a86f206a5\" (UID: \"abfac0e2-8f66-48b7-a64d-0f9a86f206a5\") "
Nov 04 01:38:20.395412 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.395306    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-kube-api-access-lv4hn\" (UniqueName: \"kubernetes.io/projected/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-kube-api-access-lv4hn\") pod \"abfac0e2-8f66-48b7-a64d-0f9a86f206a5\" (UID: \"abfac0e2-8f66-48b7-a64d-0f9a86f206a5\") "
Nov 04 01:38:20.395412 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.395382    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-openshift-service-ca\") pod \"abfac0e2-8f66-48b7-a64d-0f9a86f206a5\" (UID: \"abfac0e2-8f66-48b7-a64d-0f9a86f206a5\") "
Nov 04 01:38:20.395834 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.395799    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-openshift-service-ca" pod "abfac0e2-8f66-48b7-a64d-0f9a86f206a5" (UID: "abfac0e2-8f66-48b7-a64d-0f9a86f206a5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:38:20.397475 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.397446    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-metrics-certs" pod "abfac0e2-8f66-48b7-a64d-0f9a86f206a5" (UID: "abfac0e2-8f66-48b7-a64d-0f9a86f206a5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:38:20.397593 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.397480    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-kube-api-access-lv4hn" pod "abfac0e2-8f66-48b7-a64d-0f9a86f206a5" (UID: "abfac0e2-8f66-48b7-a64d-0f9a86f206a5"). InnerVolumeSpecName "kube-api-access-lv4hn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:38:20.397593 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.397509    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-maas-api-tls" pod "abfac0e2-8f66-48b7-a64d-0f9a86f206a5" (UID: "abfac0e2-8f66-48b7-a64d-0f9a86f206a5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:38:20.497093 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.497064    5640 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-metrics-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:38:20.497093 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.497089    5640 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-maas-api-tls\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:38:20.497093 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.497099    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lv4hn\" (UniqueName: \"kubernetes.io/projected/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-kube-api-access-lv4hn\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:38:20.497402 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.497110    5640 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abfac0e2-8f66-48b7-a64d-0f9a86f206a5-openshift-service-ca\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:38:20.586825 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.586783    5640 generic.go:356] "Generic (PLEG): container finished" podID="abfac0e2-8f66-48b7-a64d-0f9a86f206a5" containerID="2d74cf4c7183ddf93c67d33ae71538f06034add47669c9f11ed4ec195962bb2d" exitCode=0
Nov 04 01:38:20.587029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.586837    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"
Nov 04 01:38:20.587029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.586859    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78" event={"ID":"abfac0e2-8f66-48b7-a64d-0f9a86f206a5","Type":"ContainerDied","Data":"2d74cf4c7183ddf93c67d33ae71538f06034add47669c9f11ed4ec195962bb2d"}
Nov 04 01:38:20.587029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.586914    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78" event={"ID":"abfac0e2-8f66-48b7-a64d-0f9a86f206a5","Type":"ContainerDied","Data":"4fb8765f01a28579a649c6d88776b3445c97e915e252a3a06648746d0320f854"}
Nov 04 01:38:20.587029 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.586945    5640 scope.go:122] "RemoveContainer" containerID="2d74cf4c7183ddf93c67d33ae71538f06034add47669c9f11ed4ec195962bb2d"
Nov 04 01:38:20.598399 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.598379    5640 scope.go:122] "RemoveContainer" containerID="2d74cf4c7183ddf93c67d33ae71538f06034add47669c9f11ed4ec195962bb2d"
Nov 04 01:38:20.598665 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:38:20.598647    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d74cf4c7183ddf93c67d33ae71538f06034add47669c9f11ed4ec195962bb2d\": container with ID starting with 2d74cf4c7183ddf93c67d33ae71538f06034add47669c9f11ed4ec195962bb2d not found: ID does not exist" containerID="2d74cf4c7183ddf93c67d33ae71538f06034add47669c9f11ed4ec195962bb2d"
Nov 04 01:38:20.598728 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.598671    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d74cf4c7183ddf93c67d33ae71538f06034add47669c9f11ed4ec195962bb2d"} err="failed to get container status \"2d74cf4c7183ddf93c67d33ae71538f06034add47669c9f11ed4ec195962bb2d\": rpc error: code = NotFound desc = could not find container \"2d74cf4c7183ddf93c67d33ae71538f06034add47669c9f11ed4ec195962bb2d\": container with ID starting with 2d74cf4c7183ddf93c67d33ae71538f06034add47669c9f11ed4ec195962bb2d not found: ID does not exist"
Nov 04 01:38:20.756476 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.756446    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"]
Nov 04 01:38:20.760977 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:20.760944    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-9f7183-74584b7888-gdb78"]
Nov 04 01:38:21.565400 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:38:21.565372    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="abfac0e2-8f66-48b7-a64d-0f9a86f206a5" path="/var/lib/kubelet/pods/abfac0e2-8f66-48b7-a64d-0f9a86f206a5/volumes"
Nov 04 01:38:41.142705 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:38:41.142667    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:39:10.547903 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:10.547870    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"]
Nov 04 01:39:10.548455 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:10.548103    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk" podUID="c22f6e0d-eae6-4456-bb9b-b333349091a6" containerName="istio-proxy" containerID="cri-o://1d9ee14409dcbf87d3bec732a33d836c5b696e9b9aa8c36695b68f2802f37c9e" gracePeriod=30
Nov 04 01:39:11.141765 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:39:11.141728    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:39:15.812274 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.812210    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:39:15.914169 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.914133    5640 generic.go:356] "Generic (PLEG): container finished" podID="c22f6e0d-eae6-4456-bb9b-b333349091a6" containerID="1d9ee14409dcbf87d3bec732a33d836c5b696e9b9aa8c36695b68f2802f37c9e" exitCode=0
Nov 04 01:39:15.914169 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.914171    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk" event={"ID":"c22f6e0d-eae6-4456-bb9b-b333349091a6","Type":"ContainerDied","Data":"1d9ee14409dcbf87d3bec732a33d836c5b696e9b9aa8c36695b68f2802f37c9e"}
Nov 04 01:39:15.914383 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.914183    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"
Nov 04 01:39:15.914383 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.914210    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk" event={"ID":"c22f6e0d-eae6-4456-bb9b-b333349091a6","Type":"ContainerDied","Data":"8ede0287a15af3fb8bea4cb0158f9a4e7e0884dd861859411d9c2c4fb30fe810"}
Nov 04 01:39:15.914383 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.914230    5640 scope.go:122] "RemoveContainer" containerID="1d9ee14409dcbf87d3bec732a33d836c5b696e9b9aa8c36695b68f2802f37c9e"
Nov 04 01:39:15.924074 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.924054    5640 scope.go:122] "RemoveContainer" containerID="1d9ee14409dcbf87d3bec732a33d836c5b696e9b9aa8c36695b68f2802f37c9e"
Nov 04 01:39:15.924337 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:39:15.924315    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d9ee14409dcbf87d3bec732a33d836c5b696e9b9aa8c36695b68f2802f37c9e\": container with ID starting with 1d9ee14409dcbf87d3bec732a33d836c5b696e9b9aa8c36695b68f2802f37c9e not found: ID does not exist" containerID="1d9ee14409dcbf87d3bec732a33d836c5b696e9b9aa8c36695b68f2802f37c9e"
Nov 04 01:39:15.924407 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.924350    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d9ee14409dcbf87d3bec732a33d836c5b696e9b9aa8c36695b68f2802f37c9e"} err="failed to get container status \"1d9ee14409dcbf87d3bec732a33d836c5b696e9b9aa8c36695b68f2802f37c9e\": rpc error: code = NotFound desc = could not find container \"1d9ee14409dcbf87d3bec732a33d836c5b696e9b9aa8c36695b68f2802f37c9e\": container with ID starting with 1d9ee14409dcbf87d3bec732a33d836c5b696e9b9aa8c36695b68f2802f37c9e not found: ID does not exist"
Nov 04 01:39:15.951739 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.951706    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-podinfo\") pod \"c22f6e0d-eae6-4456-bb9b-b333349091a6\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") "
Nov 04 01:39:15.951884 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.951762    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-workload-socket\") pod \"c22f6e0d-eae6-4456-bb9b-b333349091a6\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") "
Nov 04 01:39:15.951884 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.951845    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-workload-certs\") pod \"c22f6e0d-eae6-4456-bb9b-b333349091a6\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") "
Nov 04 01:39:15.952008 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.951896    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-envoy\") pod \"c22f6e0d-eae6-4456-bb9b-b333349091a6\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") "
Nov 04 01:39:15.952008 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.951922    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-credential-socket\") pod \"c22f6e0d-eae6-4456-bb9b-b333349091a6\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") "
Nov 04 01:39:15.952008 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.951947    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-token\" (UniqueName: \"kubernetes.io/projected/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-token\") pod \"c22f6e0d-eae6-4456-bb9b-b333349091a6\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") "
Nov 04 01:39:15.952172 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.952062    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-data\") pod \"c22f6e0d-eae6-4456-bb9b-b333349091a6\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") "
Nov 04 01:39:15.952172 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.952104    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c22f6e0d-eae6-4456-bb9b-b333349091a6-kube-api-access-lg2nz\" (UniqueName: \"kubernetes.io/projected/c22f6e0d-eae6-4456-bb9b-b333349091a6-kube-api-access-lg2nz\") pod \"c22f6e0d-eae6-4456-bb9b-b333349091a6\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") "
Nov 04 01:39:15.952172 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.952137    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c22f6e0d-eae6-4456-bb9b-b333349091a6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c22f6e0d-eae6-4456-bb9b-b333349091a6-istiod-ca-cert\") pod \"c22f6e0d-eae6-4456-bb9b-b333349091a6\" (UID: \"c22f6e0d-eae6-4456-bb9b-b333349091a6\") "
Nov 04 01:39:15.952327 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.952250    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-credential-socket" pod "c22f6e0d-eae6-4456-bb9b-b333349091a6" (UID: "c22f6e0d-eae6-4456-bb9b-b333349091a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:39:15.952327 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.952261    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-workload-certs" pod "c22f6e0d-eae6-4456-bb9b-b333349091a6" (UID: "c22f6e0d-eae6-4456-bb9b-b333349091a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:39:15.952446 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.952363    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-data" pod "c22f6e0d-eae6-4456-bb9b-b333349091a6" (UID: "c22f6e0d-eae6-4456-bb9b-b333349091a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:39:15.952446 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.952401    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-workload-socket" pod "c22f6e0d-eae6-4456-bb9b-b333349091a6" (UID: "c22f6e0d-eae6-4456-bb9b-b333349091a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:39:15.952697 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.952662    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c22f6e0d-eae6-4456-bb9b-b333349091a6-istiod-ca-cert" pod "c22f6e0d-eae6-4456-bb9b-b333349091a6" (UID: "c22f6e0d-eae6-4456-bb9b-b333349091a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:39:15.952797 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.952777    5640 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-workload-socket\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:15.952860 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.952795    5640 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-workload-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:15.952860 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.952811    5640 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-credential-socket\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:15.952860 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.952825    5640 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-data\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:15.952860 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.952840    5640 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c22f6e0d-eae6-4456-bb9b-b333349091a6-istiod-ca-cert\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:15.954129 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.954100    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-podinfo" pod "c22f6e0d-eae6-4456-bb9b-b333349091a6" (UID: "c22f6e0d-eae6-4456-bb9b-b333349091a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 01:39:15.954302 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.954281    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-token" pod "c22f6e0d-eae6-4456-bb9b-b333349091a6" (UID: "c22f6e0d-eae6-4456-bb9b-b333349091a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:39:15.954358 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.954283    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-envoy" pod "c22f6e0d-eae6-4456-bb9b-b333349091a6" (UID: "c22f6e0d-eae6-4456-bb9b-b333349091a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:39:15.954394 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:15.954356    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c22f6e0d-eae6-4456-bb9b-b333349091a6-kube-api-access-lg2nz" pod "c22f6e0d-eae6-4456-bb9b-b333349091a6" (UID: "c22f6e0d-eae6-4456-bb9b-b333349091a6"). InnerVolumeSpecName "kube-api-access-lg2nz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:39:16.054117 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:16.054083    5640 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-podinfo\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:16.054117 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:16.054111    5640 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-envoy\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:16.054117 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:16.054126    5640 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c22f6e0d-eae6-4456-bb9b-b333349091a6-istio-token\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:16.054361 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:16.054137    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lg2nz\" (UniqueName: \"kubernetes.io/projected/c22f6e0d-eae6-4456-bb9b-b333349091a6-kube-api-access-lg2nz\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:16.342272 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:16.342232    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"]
Nov 04 01:39:16.346767 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:16.346737    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-tmzjk"]
Nov 04 01:39:17.566378 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:17.566345    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c22f6e0d-eae6-4456-bb9b-b333349091a6" path="/var/lib/kubelet/pods/c22f6e0d-eae6-4456-bb9b-b333349091a6/volumes"
Nov 04 01:39:41.142214 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:39:41.142177    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:39:59.049914 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:59.049827    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"]
Nov 04 01:39:59.101290 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:39:59.101247    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"]
Nov 04 01:40:11.143569 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:40:11.143525    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:40:14.076295 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:14.076229    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6" podUID="55853f41-4398-4769-a849-857d56ddc2fc" containerName="main" containerID="cri-o://adb292707ba4a84522d5af015caef557eebe265bb1cb1466f4e81e7957695606" gracePeriod=45
Nov 04 01:40:14.130474 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:14.129523    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm" podUID="50a257e9-8e2e-456f-b2be-fa577aed740c" containerName="main" containerID="cri-o://dbe1acda5de2f8a235028560934ac96b958e8479758ce02863f47df08e5bbdcb" gracePeriod=45
Nov 04 01:40:14.258996 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:14.258346    5640 generic.go:356] "Generic (PLEG): container finished" podID="50a257e9-8e2e-456f-b2be-fa577aed740c" containerID="dbe1acda5de2f8a235028560934ac96b958e8479758ce02863f47df08e5bbdcb" exitCode=0
Nov 04 01:40:14.258996 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:14.258488    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm" event={"ID":"50a257e9-8e2e-456f-b2be-fa577aed740c","Type":"ContainerDied","Data":"dbe1acda5de2f8a235028560934ac96b958e8479758ce02863f47df08e5bbdcb"}
Nov 04 01:40:14.261002 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:14.260368    5640 generic.go:356] "Generic (PLEG): container finished" podID="55853f41-4398-4769-a849-857d56ddc2fc" containerID="adb292707ba4a84522d5af015caef557eebe265bb1cb1466f4e81e7957695606" exitCode=0
Nov 04 01:40:14.261002 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:14.260486    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6" event={"ID":"55853f41-4398-4769-a849-857d56ddc2fc","Type":"ContainerDied","Data":"adb292707ba4a84522d5af015caef557eebe265bb1cb1466f4e81e7957695606"}
Nov 04 01:40:14.465765 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:14.465366    5640 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6" podUID="55853f41-4398-4769-a849-857d56ddc2fc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.62:8000/ready\": dial tcp 10.134.0.62:8000: connect: connection refused"
Nov 04 01:40:14.542824 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:14.539795    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp"]
Nov 04 01:40:14.942551 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:14.941354    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:40:15.108977 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.108913    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/55853f41-4398-4769-a849-857d56ddc2fc-kube-api-access-8c447\" (UniqueName: \"kubernetes.io/projected/55853f41-4398-4769-a849-857d56ddc2fc-kube-api-access-8c447\") pod \"55853f41-4398-4769-a849-857d56ddc2fc\" (UID: \"55853f41-4398-4769-a849-857d56ddc2fc\") "
Nov 04 01:40:15.109495 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.109193    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-model-cache\") pod \"55853f41-4398-4769-a849-857d56ddc2fc\" (UID: \"55853f41-4398-4769-a849-857d56ddc2fc\") "
Nov 04 01:40:15.109495 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.109337    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/55853f41-4398-4769-a849-857d56ddc2fc-tls-certs\" (UniqueName: \"kubernetes.io/secret/55853f41-4398-4769-a849-857d56ddc2fc-tls-certs\") pod \"55853f41-4398-4769-a849-857d56ddc2fc\" (UID: \"55853f41-4398-4769-a849-857d56ddc2fc\") "
Nov 04 01:40:15.109634 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.109536    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-dshm\" (UniqueName: \"kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-dshm\") pod \"55853f41-4398-4769-a849-857d56ddc2fc\" (UID: \"55853f41-4398-4769-a849-857d56ddc2fc\") "
Nov 04 01:40:15.109634 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.109627    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-tmp-dir\") pod \"55853f41-4398-4769-a849-857d56ddc2fc\" (UID: \"55853f41-4398-4769-a849-857d56ddc2fc\") "
Nov 04 01:40:15.109908 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.109886    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-home\" (UniqueName: \"kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-home\") pod \"55853f41-4398-4769-a849-857d56ddc2fc\" (UID: \"55853f41-4398-4769-a849-857d56ddc2fc\") "
Nov 04 01:40:15.130460 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.130417    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55853f41-4398-4769-a849-857d56ddc2fc-kube-api-access-8c447" pod "55853f41-4398-4769-a849-857d56ddc2fc" (UID: "55853f41-4398-4769-a849-857d56ddc2fc"). InnerVolumeSpecName "kube-api-access-8c447". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:40:15.133411 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.133374    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-dshm" pod "55853f41-4398-4769-a849-857d56ddc2fc" (UID: "55853f41-4398-4769-a849-857d56ddc2fc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:15.133645 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.133625    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-model-cache" pod "55853f41-4398-4769-a849-857d56ddc2fc" (UID: "55853f41-4398-4769-a849-857d56ddc2fc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:15.133835 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.133815    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-tmp-dir" pod "55853f41-4398-4769-a849-857d56ddc2fc" (UID: "55853f41-4398-4769-a849-857d56ddc2fc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:15.134113 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.134090    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-home" pod "55853f41-4398-4769-a849-857d56ddc2fc" (UID: "55853f41-4398-4769-a849-857d56ddc2fc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:15.146991 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.136803    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55853f41-4398-4769-a849-857d56ddc2fc-tls-certs" pod "55853f41-4398-4769-a849-857d56ddc2fc" (UID: "55853f41-4398-4769-a849-857d56ddc2fc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:40:15.211993 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.211266    5640 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55853f41-4398-4769-a849-857d56ddc2fc-tls-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:15.211993 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.211316    5640 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-dshm\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:15.211993 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.211331    5640 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-tmp-dir\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:15.211993 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.211348    5640 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-home\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:15.211993 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.211384    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8c447\" (UniqueName: \"kubernetes.io/projected/55853f41-4398-4769-a849-857d56ddc2fc-kube-api-access-8c447\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:15.211993 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.211400    5640 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55853f41-4398-4769-a849-857d56ddc2fc-model-cache\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:15.341050 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.337512    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:40:15.342964 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.342929    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm" event={"ID":"50a257e9-8e2e-456f-b2be-fa577aed740c","Type":"ContainerDied","Data":"4ae83d111e1d5566b2c687772ceae8e8566fab0a29dcb69159097950cf4ae856"}
Nov 04 01:40:15.342964 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.343016    5640 scope.go:122] "RemoveContainer" containerID="dbe1acda5de2f8a235028560934ac96b958e8479758ce02863f47df08e5bbdcb"
Nov 04 01:40:15.366314 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.366286    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"
Nov 04 01:40:15.419224 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.419181    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6" event={"ID":"55853f41-4398-4769-a849-857d56ddc2fc","Type":"ContainerDied","Data":"b0f24361b9633a6856e0fc69c831013f1173e073d26b1230d19a5c833dbc5c1d"}
Nov 04 01:40:15.419556 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.419538    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"
Nov 04 01:40:15.428552 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.428528    5640 scope.go:122] "RemoveContainer" containerID="adb292707ba4a84522d5af015caef557eebe265bb1cb1466f4e81e7957695606"
Nov 04 01:40:15.429562 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.429540    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-home\" (UniqueName: \"kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-home\") pod \"50a257e9-8e2e-456f-b2be-fa577aed740c\" (UID: \"50a257e9-8e2e-456f-b2be-fa577aed740c\") "
Nov 04 01:40:15.429796 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.429775    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-tmp-dir\") pod \"50a257e9-8e2e-456f-b2be-fa577aed740c\" (UID: \"50a257e9-8e2e-456f-b2be-fa577aed740c\") "
Nov 04 01:40:15.431101 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.430795    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-home" pod "50a257e9-8e2e-456f-b2be-fa577aed740c" (UID: "50a257e9-8e2e-456f-b2be-fa577aed740c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:15.431101 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.431056    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/50a257e9-8e2e-456f-b2be-fa577aed740c-tls-certs\" (UniqueName: \"kubernetes.io/secret/50a257e9-8e2e-456f-b2be-fa577aed740c-tls-certs\") pod \"50a257e9-8e2e-456f-b2be-fa577aed740c\" (UID: \"50a257e9-8e2e-456f-b2be-fa577aed740c\") "
Nov 04 01:40:15.431258 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.431134    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-dshm\" (UniqueName: \"kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-dshm\") pod \"50a257e9-8e2e-456f-b2be-fa577aed740c\" (UID: \"50a257e9-8e2e-456f-b2be-fa577aed740c\") "
Nov 04 01:40:15.431258 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.431165    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-model-cache\") pod \"50a257e9-8e2e-456f-b2be-fa577aed740c\" (UID: \"50a257e9-8e2e-456f-b2be-fa577aed740c\") "
Nov 04 01:40:15.431258 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.430859    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-tmp-dir" pod "50a257e9-8e2e-456f-b2be-fa577aed740c" (UID: "50a257e9-8e2e-456f-b2be-fa577aed740c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:15.431258 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.431241    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50a257e9-8e2e-456f-b2be-fa577aed740c-kube-api-access-v8frt\" (UniqueName: \"kubernetes.io/projected/50a257e9-8e2e-456f-b2be-fa577aed740c-kube-api-access-v8frt\") pod \"50a257e9-8e2e-456f-b2be-fa577aed740c\" (UID: \"50a257e9-8e2e-456f-b2be-fa577aed740c\") "
Nov 04 01:40:15.431538 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.431495    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-model-cache" pod "50a257e9-8e2e-456f-b2be-fa577aed740c" (UID: "50a257e9-8e2e-456f-b2be-fa577aed740c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:15.432380 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.431719    5640 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-home\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:15.432380 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.431744    5640 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-tmp-dir\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:15.432380 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.431759    5640 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-model-cache\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:15.435489 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.435450    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-dshm" pod "50a257e9-8e2e-456f-b2be-fa577aed740c" (UID: "50a257e9-8e2e-456f-b2be-fa577aed740c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:15.435834 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.435803    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50a257e9-8e2e-456f-b2be-fa577aed740c-tls-certs" pod "50a257e9-8e2e-456f-b2be-fa577aed740c" (UID: "50a257e9-8e2e-456f-b2be-fa577aed740c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:40:15.436338 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.436319    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50a257e9-8e2e-456f-b2be-fa577aed740c-kube-api-access-v8frt" pod "50a257e9-8e2e-456f-b2be-fa577aed740c" (UID: "50a257e9-8e2e-456f-b2be-fa577aed740c"). InnerVolumeSpecName "kube-api-access-v8frt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:40:15.536000 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.533949    5640 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50a257e9-8e2e-456f-b2be-fa577aed740c-tls-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:15.536000 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.534010    5640 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50a257e9-8e2e-456f-b2be-fa577aed740c-dshm\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:15.536000 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.534028    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8frt\" (UniqueName: \"kubernetes.io/projected/50a257e9-8e2e-456f-b2be-fa577aed740c-kube-api-access-v8frt\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:15.841092 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.839365    5640 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm" podUID="50a257e9-8e2e-456f-b2be-fa577aed740c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 01:40:15.929222 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.929105    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"]
Nov 04 01:40:15.933639 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:15.933595    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-b2eadb/distinct-2-w4-b2eadb-kserve-7c89997f78-wkss6"]
Nov 04 01:40:16.136425 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:16.132700    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"]
Nov 04 01:40:16.136425 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:16.136338    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-b2eadb/distinct-w4-b2eadb-kserve-6c8f67cb69-lvtkm"]
Nov 04 01:40:16.143835 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:40:16.140033    5640 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50a257e9_8e2e_456f_b2be_fa577aed740c.slice/crio-4ae83d111e1d5566b2c687772ceae8e8566fab0a29dcb69159097950cf4ae856\": RecentStats: unable to find data in memory cache]"
Nov 04 01:40:17.565834 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:17.565801    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="50a257e9-8e2e-456f-b2be-fa577aed740c" path="/var/lib/kubelet/pods/50a257e9-8e2e-456f-b2be-fa577aed740c/volumes"
Nov 04 01:40:17.566356 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:17.566264    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="55853f41-4398-4769-a849-857d56ddc2fc" path="/var/lib/kubelet/pods/55853f41-4398-4769-a849-857d56ddc2fc/volumes"
Nov 04 01:40:19.540156 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:19.540108    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp" podUID="b471b303-951d-4e37-8046-5b6587e12e93" containerName="payload-pre-processing" containerID="cri-o://d6cb2412a37196cd4b43f6de06bc61beb846081a53af5ebd8d78ff6706adcf6e" gracePeriod=25
Nov 04 01:40:22.639049 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:22.639014    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6"]
Nov 04 01:40:27.640408 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:27.640356    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6" podUID="477de01d-712a-435c-a3e1-afb1b9d6b8d4" containerName="payload-processing" containerID="cri-o://17aea24896c7a846ea46d5daea403172111d46875ee4cba0cd0f1dd803f63f0d" gracePeriod=25
Nov 04 01:40:29.356784 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:29.356743    5640 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp" podUID="b471b303-951d-4e37-8046-5b6587e12e93" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 01:40:33.198227 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:33.198187    5640 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6" podUID="477de01d-712a-435c-a3e1-afb1b9d6b8d4" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 01:40:39.356949 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:39.356911    5640 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp" podUID="b471b303-951d-4e37-8046-5b6587e12e93" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 01:40:39.823904 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:39.823869    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp"
Nov 04 01:40:39.960313 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:39.960210    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b471b303-951d-4e37-8046-5b6587e12e93-kube-api-access-hf9j5\" (UniqueName: \"kubernetes.io/projected/b471b303-951d-4e37-8046-5b6587e12e93-kube-api-access-hf9j5\") pod \"b471b303-951d-4e37-8046-5b6587e12e93\" (UID: \"b471b303-951d-4e37-8046-5b6587e12e93\") "
Nov 04 01:40:39.960501 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:39.960381    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b471b303-951d-4e37-8046-5b6587e12e93-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b471b303-951d-4e37-8046-5b6587e12e93-plugins-config-volume\") pod \"b471b303-951d-4e37-8046-5b6587e12e93\" (UID: \"b471b303-951d-4e37-8046-5b6587e12e93\") "
Nov 04 01:40:39.961168 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:39.961142    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b471b303-951d-4e37-8046-5b6587e12e93-plugins-config-volume" pod "b471b303-951d-4e37-8046-5b6587e12e93" (UID: "b471b303-951d-4e37-8046-5b6587e12e93"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:40:39.963169 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:39.963136    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b471b303-951d-4e37-8046-5b6587e12e93-kube-api-access-hf9j5" pod "b471b303-951d-4e37-8046-5b6587e12e93" (UID: "b471b303-951d-4e37-8046-5b6587e12e93"). InnerVolumeSpecName "kube-api-access-hf9j5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:40:40.061792 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:40.061746    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hf9j5\" (UniqueName: \"kubernetes.io/projected/b471b303-951d-4e37-8046-5b6587e12e93-kube-api-access-hf9j5\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:40.061792 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:40.061782    5640 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b471b303-951d-4e37-8046-5b6587e12e93-plugins-config-volume\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:40.590949 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:40.590912    5640 generic.go:356] "Generic (PLEG): container finished" podID="b471b303-951d-4e37-8046-5b6587e12e93" containerID="d6cb2412a37196cd4b43f6de06bc61beb846081a53af5ebd8d78ff6706adcf6e" exitCode=0
Nov 04 01:40:40.591457 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:40.591012    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp"
Nov 04 01:40:40.591457 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:40.591018    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp" event={"ID":"b471b303-951d-4e37-8046-5b6587e12e93","Type":"ContainerDied","Data":"d6cb2412a37196cd4b43f6de06bc61beb846081a53af5ebd8d78ff6706adcf6e"}
Nov 04 01:40:40.591457 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:40.591083    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp" event={"ID":"b471b303-951d-4e37-8046-5b6587e12e93","Type":"ContainerDied","Data":"2007eee8aca60fd4620ec2d85a9f61606fa453ea5ccfa8979fd8af2912450866"}
Nov 04 01:40:40.591457 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:40.591116    5640 scope.go:122] "RemoveContainer" containerID="d6cb2412a37196cd4b43f6de06bc61beb846081a53af5ebd8d78ff6706adcf6e"
Nov 04 01:40:40.603211 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:40.603192    5640 scope.go:122] "RemoveContainer" containerID="d6cb2412a37196cd4b43f6de06bc61beb846081a53af5ebd8d78ff6706adcf6e"
Nov 04 01:40:40.603780 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:40:40.603749    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6cb2412a37196cd4b43f6de06bc61beb846081a53af5ebd8d78ff6706adcf6e\": container with ID starting with d6cb2412a37196cd4b43f6de06bc61beb846081a53af5ebd8d78ff6706adcf6e not found: ID does not exist" containerID="d6cb2412a37196cd4b43f6de06bc61beb846081a53af5ebd8d78ff6706adcf6e"
Nov 04 01:40:40.603869 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:40.603786    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6cb2412a37196cd4b43f6de06bc61beb846081a53af5ebd8d78ff6706adcf6e"} err="failed to get container status \"d6cb2412a37196cd4b43f6de06bc61beb846081a53af5ebd8d78ff6706adcf6e\": rpc error: code = NotFound desc = could not find container \"d6cb2412a37196cd4b43f6de06bc61beb846081a53af5ebd8d78ff6706adcf6e\": container with ID starting with d6cb2412a37196cd4b43f6de06bc61beb846081a53af5ebd8d78ff6706adcf6e not found: ID does not exist"
Nov 04 01:40:40.761849 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:40.761817    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp"]
Nov 04 01:40:40.812319 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:40.812273    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-b2eadb-668f7d8bdc-vkhcp"]
Nov 04 01:40:41.142739 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:40:41.142705    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:40:41.564783 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:41.564751    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b471b303-951d-4e37-8046-5b6587e12e93" path="/var/lib/kubelet/pods/b471b303-951d-4e37-8046-5b6587e12e93/volumes"
Nov 04 01:40:43.197509 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:43.197473    5640 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6" podUID="477de01d-712a-435c-a3e1-afb1b9d6b8d4" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 01:40:44.370501 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:44.370462    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"]
Nov 04 01:40:44.370948 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:44.370687    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr" podUID="3a3a0f69-18a0-4089-a37e-2034c873bde6" containerName="istio-proxy" containerID="cri-o://e01ba0f13362b9ad02a463c613e9c2d020e1d576ec6557df580e5125ab74feaa" gracePeriod=30
Nov 04 01:40:46.553325 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:46.553289    5640 patch_prober.go:29] interesting pod/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 01:40:46.553731 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:46.553352    5640 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr" podUID="3a3a0f69-18a0-4089-a37e-2034c873bde6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 01:40:47.916371 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:47.916338    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6"
Nov 04 01:40:47.951576 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:47.951547    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/477de01d-712a-435c-a3e1-afb1b9d6b8d4-kube-api-access-ksft8\" (UniqueName: \"kubernetes.io/projected/477de01d-712a-435c-a3e1-afb1b9d6b8d4-kube-api-access-ksft8\") pod \"477de01d-712a-435c-a3e1-afb1b9d6b8d4\" (UID: \"477de01d-712a-435c-a3e1-afb1b9d6b8d4\") "
Nov 04 01:40:47.951778 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:47.951722    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/477de01d-712a-435c-a3e1-afb1b9d6b8d4-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/477de01d-712a-435c-a3e1-afb1b9d6b8d4-plugins-config-volume\") pod \"477de01d-712a-435c-a3e1-afb1b9d6b8d4\" (UID: \"477de01d-712a-435c-a3e1-afb1b9d6b8d4\") "
Nov 04 01:40:47.952123 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:47.952100    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/477de01d-712a-435c-a3e1-afb1b9d6b8d4-plugins-config-volume" pod "477de01d-712a-435c-a3e1-afb1b9d6b8d4" (UID: "477de01d-712a-435c-a3e1-afb1b9d6b8d4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:40:47.953683 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:47.953661    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/477de01d-712a-435c-a3e1-afb1b9d6b8d4-kube-api-access-ksft8" pod "477de01d-712a-435c-a3e1-afb1b9d6b8d4" (UID: "477de01d-712a-435c-a3e1-afb1b9d6b8d4"). InnerVolumeSpecName "kube-api-access-ksft8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:40:48.053628 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:48.053580    5640 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/477de01d-712a-435c-a3e1-afb1b9d6b8d4-plugins-config-volume\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:48.053628 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:48.053616    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksft8\" (UniqueName: \"kubernetes.io/projected/477de01d-712a-435c-a3e1-afb1b9d6b8d4-kube-api-access-ksft8\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:48.640403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:48.640370    5640 generic.go:356] "Generic (PLEG): container finished" podID="477de01d-712a-435c-a3e1-afb1b9d6b8d4" containerID="17aea24896c7a846ea46d5daea403172111d46875ee4cba0cd0f1dd803f63f0d" exitCode=0
Nov 04 01:40:48.640403 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:48.640414    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6" event={"ID":"477de01d-712a-435c-a3e1-afb1b9d6b8d4","Type":"ContainerDied","Data":"17aea24896c7a846ea46d5daea403172111d46875ee4cba0cd0f1dd803f63f0d"}
Nov 04 01:40:48.640638 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:48.640437    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6"
Nov 04 01:40:48.640638 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:48.640455    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6" event={"ID":"477de01d-712a-435c-a3e1-afb1b9d6b8d4","Type":"ContainerDied","Data":"9213f769e7c5b522335710f8f0a9d75a49ea9a1f0cf2b861edf7c63dd9be2f91"}
Nov 04 01:40:48.640638 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:48.640476    5640 scope.go:122] "RemoveContainer" containerID="17aea24896c7a846ea46d5daea403172111d46875ee4cba0cd0f1dd803f63f0d"
Nov 04 01:40:48.650337 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:48.650310    5640 scope.go:122] "RemoveContainer" containerID="17aea24896c7a846ea46d5daea403172111d46875ee4cba0cd0f1dd803f63f0d"
Nov 04 01:40:48.650673 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:40:48.650651    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17aea24896c7a846ea46d5daea403172111d46875ee4cba0cd0f1dd803f63f0d\": container with ID starting with 17aea24896c7a846ea46d5daea403172111d46875ee4cba0cd0f1dd803f63f0d not found: ID does not exist" containerID="17aea24896c7a846ea46d5daea403172111d46875ee4cba0cd0f1dd803f63f0d"
Nov 04 01:40:48.650751 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:48.650686    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17aea24896c7a846ea46d5daea403172111d46875ee4cba0cd0f1dd803f63f0d"} err="failed to get container status \"17aea24896c7a846ea46d5daea403172111d46875ee4cba0cd0f1dd803f63f0d\": rpc error: code = NotFound desc = could not find container \"17aea24896c7a846ea46d5daea403172111d46875ee4cba0cd0f1dd803f63f0d\": container with ID starting with 17aea24896c7a846ea46d5daea403172111d46875ee4cba0cd0f1dd803f63f0d not found: ID does not exist"
Nov 04 01:40:48.809997 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:48.809947    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6"]
Nov 04 01:40:48.813728 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:48.813696    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-00cfe6-84444cfdcd-chqm6"]
Nov 04 01:40:49.568048 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.568011    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="477de01d-712a-435c-a3e1-afb1b9d6b8d4" path="/var/lib/kubelet/pods/477de01d-712a-435c-a3e1-afb1b9d6b8d4/volumes"
Nov 04 01:40:49.637745 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.637685    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:40:49.647917 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.647884    5640 generic.go:356] "Generic (PLEG): container finished" podID="3a3a0f69-18a0-4089-a37e-2034c873bde6" containerID="e01ba0f13362b9ad02a463c613e9c2d020e1d576ec6557df580e5125ab74feaa" exitCode=0
Nov 04 01:40:49.648083 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.647922    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr" event={"ID":"3a3a0f69-18a0-4089-a37e-2034c873bde6","Type":"ContainerDied","Data":"e01ba0f13362b9ad02a463c613e9c2d020e1d576ec6557df580e5125ab74feaa"}
Nov 04 01:40:49.648083 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.647933    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"
Nov 04 01:40:49.648083 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.647999    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr" event={"ID":"3a3a0f69-18a0-4089-a37e-2034c873bde6","Type":"ContainerDied","Data":"9baff459d05e7f0291266cabde5c1387fe7d6336fdb074f197fa8c47306fa2b1"}
Nov 04 01:40:49.648083 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.648015    5640 scope.go:122] "RemoveContainer" containerID="e01ba0f13362b9ad02a463c613e9c2d020e1d576ec6557df580e5125ab74feaa"
Nov 04 01:40:49.662021 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.661995    5640 scope.go:122] "RemoveContainer" containerID="215ef5acda28cceb7367311e1c4ad5a13d6147f9db5f7969d218e555f5e0e4dc"
Nov 04 01:40:49.671298 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.671273    5640 scope.go:122] "RemoveContainer" containerID="e01ba0f13362b9ad02a463c613e9c2d020e1d576ec6557df580e5125ab74feaa"
Nov 04 01:40:49.671481 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.671459    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-workload-socket\") pod \"3a3a0f69-18a0-4089-a37e-2034c873bde6\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") "
Nov 04 01:40:49.671540 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.671525    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-token\" (UniqueName: \"kubernetes.io/projected/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-token\") pod \"3a3a0f69-18a0-4089-a37e-2034c873bde6\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") "
Nov 04 01:40:49.671591 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.671576    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3a3a0f69-18a0-4089-a37e-2034c873bde6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a3a0f69-18a0-4089-a37e-2034c873bde6-istiod-ca-cert\") pod \"3a3a0f69-18a0-4089-a37e-2034c873bde6\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") "
Nov 04 01:40:49.671651 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.671637    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-workload-certs\") pod \"3a3a0f69-18a0-4089-a37e-2034c873bde6\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") "
Nov 04 01:40:49.671690 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:40:49.671662    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e01ba0f13362b9ad02a463c613e9c2d020e1d576ec6557df580e5125ab74feaa\": container with ID starting with e01ba0f13362b9ad02a463c613e9c2d020e1d576ec6557df580e5125ab74feaa not found: ID does not exist" containerID="e01ba0f13362b9ad02a463c613e9c2d020e1d576ec6557df580e5125ab74feaa"
Nov 04 01:40:49.671690 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.671678    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-data\") pod \"3a3a0f69-18a0-4089-a37e-2034c873bde6\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") "
Nov 04 01:40:49.671773 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.671695    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e01ba0f13362b9ad02a463c613e9c2d020e1d576ec6557df580e5125ab74feaa"} err="failed to get container status \"e01ba0f13362b9ad02a463c613e9c2d020e1d576ec6557df580e5125ab74feaa\": rpc error: code = NotFound desc = could not find container \"e01ba0f13362b9ad02a463c613e9c2d020e1d576ec6557df580e5125ab74feaa\": container with ID starting with e01ba0f13362b9ad02a463c613e9c2d020e1d576ec6557df580e5125ab74feaa not found: ID does not exist"
Nov 04 01:40:49.671773 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.671724    5640 scope.go:122] "RemoveContainer" containerID="215ef5acda28cceb7367311e1c4ad5a13d6147f9db5f7969d218e555f5e0e4dc"
Nov 04 01:40:49.671773 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.671738    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-workload-socket" pod "3a3a0f69-18a0-4089-a37e-2034c873bde6" (UID: "3a3a0f69-18a0-4089-a37e-2034c873bde6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:49.671773 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.671750    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3a3a0f69-18a0-4089-a37e-2034c873bde6-kube-api-access-f269r\" (UniqueName: \"kubernetes.io/projected/3a3a0f69-18a0-4089-a37e-2034c873bde6-kube-api-access-f269r\") pod \"3a3a0f69-18a0-4089-a37e-2034c873bde6\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") "
Nov 04 01:40:49.671993 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.671813    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-podinfo\") pod \"3a3a0f69-18a0-4089-a37e-2034c873bde6\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") "
Nov 04 01:40:49.671993 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.671861    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-envoy\") pod \"3a3a0f69-18a0-4089-a37e-2034c873bde6\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") "
Nov 04 01:40:49.671993 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.671909    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-workload-certs" pod "3a3a0f69-18a0-4089-a37e-2034c873bde6" (UID: "3a3a0f69-18a0-4089-a37e-2034c873bde6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:49.671993 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.671950    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-data" pod "3a3a0f69-18a0-4089-a37e-2034c873bde6" (UID: "3a3a0f69-18a0-4089-a37e-2034c873bde6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:49.671993 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.671924    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-credential-socket\") pod \"3a3a0f69-18a0-4089-a37e-2034c873bde6\" (UID: \"3a3a0f69-18a0-4089-a37e-2034c873bde6\") "
Nov 04 01:40:49.672228 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.672054    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a3a0f69-18a0-4089-a37e-2034c873bde6-istiod-ca-cert" pod "3a3a0f69-18a0-4089-a37e-2034c873bde6" (UID: "3a3a0f69-18a0-4089-a37e-2034c873bde6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:40:49.672228 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.672151    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-credential-socket" pod "3a3a0f69-18a0-4089-a37e-2034c873bde6" (UID: "3a3a0f69-18a0-4089-a37e-2034c873bde6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:49.672341 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:40:49.672230    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"215ef5acda28cceb7367311e1c4ad5a13d6147f9db5f7969d218e555f5e0e4dc\": container with ID starting with 215ef5acda28cceb7367311e1c4ad5a13d6147f9db5f7969d218e555f5e0e4dc not found: ID does not exist" containerID="215ef5acda28cceb7367311e1c4ad5a13d6147f9db5f7969d218e555f5e0e4dc"
Nov 04 01:40:49.672341 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.672261    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"215ef5acda28cceb7367311e1c4ad5a13d6147f9db5f7969d218e555f5e0e4dc"} err="failed to get container status \"215ef5acda28cceb7367311e1c4ad5a13d6147f9db5f7969d218e555f5e0e4dc\": rpc error: code = NotFound desc = could not find container \"215ef5acda28cceb7367311e1c4ad5a13d6147f9db5f7969d218e555f5e0e4dc\": container with ID starting with 215ef5acda28cceb7367311e1c4ad5a13d6147f9db5f7969d218e555f5e0e4dc not found: ID does not exist"
Nov 04 01:40:49.672790 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.672767    5640 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-credential-socket\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:49.672790 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.672796    5640 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-workload-socket\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:49.672955 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.672813    5640 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a3a0f69-18a0-4089-a37e-2034c873bde6-istiod-ca-cert\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:49.672955 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.672828    5640 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-workload-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:49.672955 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.672844    5640 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-data\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:49.674009 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.673980    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-token" pod "3a3a0f69-18a0-4089-a37e-2034c873bde6" (UID: "3a3a0f69-18a0-4089-a37e-2034c873bde6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:40:49.674209 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.674187    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a3a0f69-18a0-4089-a37e-2034c873bde6-kube-api-access-f269r" pod "3a3a0f69-18a0-4089-a37e-2034c873bde6" (UID: "3a3a0f69-18a0-4089-a37e-2034c873bde6"). InnerVolumeSpecName "kube-api-access-f269r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:40:49.674280 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.674261    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-envoy" pod "3a3a0f69-18a0-4089-a37e-2034c873bde6" (UID: "3a3a0f69-18a0-4089-a37e-2034c873bde6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:49.674632 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.674612    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-podinfo" pod "3a3a0f69-18a0-4089-a37e-2034c873bde6" (UID: "3a3a0f69-18a0-4089-a37e-2034c873bde6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 01:40:49.774292 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.774256    5640 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-token\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:49.774292 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.774290    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f269r\" (UniqueName: \"kubernetes.io/projected/3a3a0f69-18a0-4089-a37e-2034c873bde6-kube-api-access-f269r\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:49.774292 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.774302    5640 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-podinfo\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:49.774551 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:49.774311    5640 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a3a0f69-18a0-4089-a37e-2034c873bde6-istio-envoy\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:50.072854 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:50.072823    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"]
Nov 04 01:40:50.079424 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:50.079394    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-fbkvr"]
Nov 04 01:40:51.565324 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:51.565288    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3a3a0f69-18a0-4089-a37e-2034c873bde6" path="/var/lib/kubelet/pods/3a3a0f69-18a0-4089-a37e-2034c873bde6/volumes"
Nov 04 01:40:56.420590 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.420547    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"]
Nov 04 01:40:56.421293 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421272    5640 cpu_manager.go:414] "containerMap: removing container" podUID="e678048d-06f8-4101-85e2-b0c5d125238a" containerName="istio-proxy"
Nov 04 01:40:56.421423 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421294    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e678048d-06f8-4101-85e2-b0c5d125238a" containerName="istio-proxy"
Nov 04 01:40:56.421423 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421325    5640 cpu_manager.go:414] "containerMap: removing container" podUID="abfac0e2-8f66-48b7-a64d-0f9a86f206a5" containerName="maas-api"
Nov 04 01:40:56.421423 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421332    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="abfac0e2-8f66-48b7-a64d-0f9a86f206a5" containerName="maas-api"
Nov 04 01:40:56.421423 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421345    5640 cpu_manager.go:414] "containerMap: removing container" podUID="96ccdcef-08b4-4c72-b50b-be349fadb0b0" containerName="maas-api"
Nov 04 01:40:56.421423 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421354    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96ccdcef-08b4-4c72-b50b-be349fadb0b0" containerName="maas-api"
Nov 04 01:40:56.421423 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421371    5640 cpu_manager.go:414] "containerMap: removing container" podUID="c22f6e0d-eae6-4456-bb9b-b333349091a6" containerName="istio-proxy"
Nov 04 01:40:56.421423 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421379    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c22f6e0d-eae6-4456-bb9b-b333349091a6" containerName="istio-proxy"
Nov 04 01:40:56.421423 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421396    5640 cpu_manager.go:414] "containerMap: removing container" podUID="e678048d-06f8-4101-85e2-b0c5d125238a" containerName="istio-proxy"
Nov 04 01:40:56.421423 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421403    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e678048d-06f8-4101-85e2-b0c5d125238a" containerName="istio-proxy"
Nov 04 01:40:56.421423 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421416    5640 cpu_manager.go:414] "containerMap: removing container" podUID="477de01d-712a-435c-a3e1-afb1b9d6b8d4" containerName="payload-processing"
Nov 04 01:40:56.421423 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421423    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="477de01d-712a-435c-a3e1-afb1b9d6b8d4" containerName="payload-processing"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421435    5640 cpu_manager.go:414] "containerMap: removing container" podUID="50a257e9-8e2e-456f-b2be-fa577aed740c" containerName="main"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421441    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50a257e9-8e2e-456f-b2be-fa577aed740c" containerName="main"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421451    5640 cpu_manager.go:414] "containerMap: removing container" podUID="55853f41-4398-4769-a849-857d56ddc2fc" containerName="main"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421459    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="55853f41-4398-4769-a849-857d56ddc2fc" containerName="main"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421471    5640 cpu_manager.go:414] "containerMap: removing container" podUID="1f451fd0-3f5b-464e-8e0a-c308fb4be072" containerName="main"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421478    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f451fd0-3f5b-464e-8e0a-c308fb4be072" containerName="main"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421499    5640 cpu_manager.go:414] "containerMap: removing container" podUID="3a3a0f69-18a0-4089-a37e-2034c873bde6" containerName="istio-proxy"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421509    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3a3a0f69-18a0-4089-a37e-2034c873bde6" containerName="istio-proxy"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421526    5640 cpu_manager.go:414] "containerMap: removing container" podUID="ad129c82-d850-4d18-97cc-707534ab121a" containerName="payload-pre-processing"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421533    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad129c82-d850-4d18-97cc-707534ab121a" containerName="payload-pre-processing"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421547    5640 cpu_manager.go:414] "containerMap: removing container" podUID="7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8" containerName="payload-processing"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421555    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8" containerName="payload-processing"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421584    5640 cpu_manager.go:414] "containerMap: removing container" podUID="b471b303-951d-4e37-8046-5b6587e12e93" containerName="payload-pre-processing"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421592    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b471b303-951d-4e37-8046-5b6587e12e93" containerName="payload-pre-processing"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421608    5640 cpu_manager.go:414] "containerMap: removing container" podUID="3a3a0f69-18a0-4089-a37e-2034c873bde6" containerName="istio-proxy"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421616    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3a3a0f69-18a0-4089-a37e-2034c873bde6" containerName="istio-proxy"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421734    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="abfac0e2-8f66-48b7-a64d-0f9a86f206a5" containerName="maas-api"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421749    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="96ccdcef-08b4-4c72-b50b-be349fadb0b0" containerName="maas-api"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421757    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="c22f6e0d-eae6-4456-bb9b-b333349091a6" containerName="istio-proxy"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421768    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="e678048d-06f8-4101-85e2-b0c5d125238a" containerName="istio-proxy"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421776    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="477de01d-712a-435c-a3e1-afb1b9d6b8d4" containerName="payload-processing"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421784    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="50a257e9-8e2e-456f-b2be-fa577aed740c" containerName="main"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421793    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="55853f41-4398-4769-a849-857d56ddc2fc" containerName="main"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421803    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="1f451fd0-3f5b-464e-8e0a-c308fb4be072" containerName="main"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421812    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="3a3a0f69-18a0-4089-a37e-2034c873bde6" containerName="istio-proxy"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421822    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="ad129c82-d850-4d18-97cc-707534ab121a" containerName="payload-pre-processing"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421831    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="7b4e6fda-1ba7-4724-88ec-8dfa46eb6ae8" containerName="payload-processing"
Nov 04 01:40:56.422040 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.421841    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="b471b303-951d-4e37-8046-5b6587e12e93" containerName="payload-pre-processing"
Nov 04 01:40:56.427441 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.427418    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.490921 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.490874    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d46129f1-9405-4d08-aa5a-59ab37046d40-istiod-ca-cert\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.491124 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.490929    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-envoy\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.491124 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.491070    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-workload-certs\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.491124 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.491110    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-data\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.491274 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.491181    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-credential-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.491274 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.491224    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-token\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.491274 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.491243    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww64f\" (UniqueName: \"kubernetes.io/projected/d46129f1-9405-4d08-aa5a-59ab37046d40-kube-api-access-ww64f\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.491429 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.491383    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-podinfo\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.491510 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.491492    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-workload-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.515633 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.515592    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"]
Nov 04 01:40:56.592698 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.592657    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-token\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.592874 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.592709    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww64f\" (UniqueName: \"kubernetes.io/projected/d46129f1-9405-4d08-aa5a-59ab37046d40-kube-api-access-ww64f\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.592874 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.592763    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-podinfo\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.592874 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.592822    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-workload-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.593091 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.592892    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d46129f1-9405-4d08-aa5a-59ab37046d40-istiod-ca-cert\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.593091 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.592920    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-envoy\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.593091 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.593022    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-workload-certs\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.593091 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.593056    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-data\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.593291 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.593098    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-credential-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.593434 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.593399    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-workload-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.593552 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.593456    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-workload-certs\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.593703 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.593684    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-data\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.594048 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.594024    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d46129f1-9405-4d08-aa5a-59ab37046d40-istiod-ca-cert\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.594299 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.594278    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-credential-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.595509 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.595479    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-envoy\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.595721 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.595706    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-podinfo\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.655716 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.655679    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww64f\" (UniqueName: \"kubernetes.io/projected/d46129f1-9405-4d08-aa5a-59ab37046d40-kube-api-access-ww64f\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.655872 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.655680    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-token\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:56.743323 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:56.743209    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:57.183106 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:57.183076    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"]
Nov 04 01:40:57.184270 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:40:57.184222    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd46129f1_9405_4d08_aa5a_59ab37046d40.slice/crio-d214c2893001dc817f4bdafaf7d0ecadfcdc0b75b7ce783c07210160bd74f5a1 WatchSource:0}: Error finding container d214c2893001dc817f4bdafaf7d0ecadfcdc0b75b7ce783c07210160bd74f5a1: Status 404 returned error can't find the container with id d214c2893001dc817f4bdafaf7d0ecadfcdc0b75b7ce783c07210160bd74f5a1
Nov 04 01:40:57.187393 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:57.187343    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:40:57.187537 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:57.187454    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:40:57.187537 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:57.187500    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:40:57.743994 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:57.743932    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6" event={"ID":"d46129f1-9405-4d08-aa5a-59ab37046d40","Type":"ContainerStarted","Data":"27234bb3f943669b7a016c9669bdd580b05704686c464a530ad3e0bd7858a06a"}
Nov 04 01:40:57.744418 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:57.744009    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6" event={"ID":"d46129f1-9405-4d08-aa5a-59ab37046d40","Type":"ContainerStarted","Data":"d214c2893001dc817f4bdafaf7d0ecadfcdc0b75b7ce783c07210160bd74f5a1"}
Nov 04 01:40:57.886656 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:57.886602    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6" podStartSLOduration=1.88658719 podStartE2EDuration="1.88658719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:40:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:40:57.885202063 +0000 UTC m=+1780.437662236" watchObservedRunningTime="2026-11-04 01:40:57.88658719 +0000 UTC m=+1780.439047317"
Nov 04 01:40:58.743548 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:58.743511    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:58.749111 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:58.749080    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:58.750300 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:58.750274    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:40:58.751241 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:40:58.751220    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:41:07.694308 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:07.694274    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"]
Nov 04 01:41:07.694746 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:07.694481    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6" podUID="d46129f1-9405-4d08-aa5a-59ab37046d40" containerName="istio-proxy" containerID="cri-o://27234bb3f943669b7a016c9669bdd580b05704686c464a530ad3e0bd7858a06a" gracePeriod=30
Nov 04 01:41:07.702015 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:07.701987    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"]
Nov 04 01:41:07.702250 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:07.702212    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc" podUID="1d85cafc-0f17-463f-a993-48d4a9c918c4" containerName="istio-proxy" containerID="cri-o://fdcd7a9ae95936988138c0b09511070f734fe12b545fdc4e06069038b9772ec5" gracePeriod=30
Nov 04 01:41:11.141996 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:41:11.141947    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:41:12.829213 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:12.829178    5640 generic.go:356] "Generic (PLEG): container finished" podID="1d85cafc-0f17-463f-a993-48d4a9c918c4" containerID="fdcd7a9ae95936988138c0b09511070f734fe12b545fdc4e06069038b9772ec5" exitCode=0
Nov 04 01:41:12.829586 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:12.829245    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc" event={"ID":"1d85cafc-0f17-463f-a993-48d4a9c918c4","Type":"ContainerDied","Data":"fdcd7a9ae95936988138c0b09511070f734fe12b545fdc4e06069038b9772ec5"}
Nov 04 01:41:12.831210 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:12.831186    5640 generic.go:356] "Generic (PLEG): container finished" podID="d46129f1-9405-4d08-aa5a-59ab37046d40" containerID="27234bb3f943669b7a016c9669bdd580b05704686c464a530ad3e0bd7858a06a" exitCode=0
Nov 04 01:41:12.831346 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:12.831269    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6" event={"ID":"d46129f1-9405-4d08-aa5a-59ab37046d40","Type":"ContainerDied","Data":"27234bb3f943669b7a016c9669bdd580b05704686c464a530ad3e0bd7858a06a"}
Nov 04 01:41:12.963546 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:12.963480    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:41:12.993792 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:12.993768    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:41:13.005267 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.005245    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-workload-socket\") pod \"d46129f1-9405-4d08-aa5a-59ab37046d40\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") "
Nov 04 01:41:13.005354 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.005284    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-token\" (UniqueName: \"kubernetes.io/projected/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-token\") pod \"1d85cafc-0f17-463f-a993-48d4a9c918c4\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") "
Nov 04 01:41:13.005354 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.005320    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-token\" (UniqueName: \"kubernetes.io/projected/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-token\") pod \"d46129f1-9405-4d08-aa5a-59ab37046d40\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") "
Nov 04 01:41:13.005354 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.005345    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-podinfo\") pod \"1d85cafc-0f17-463f-a993-48d4a9c918c4\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") "
Nov 04 01:41:13.005499 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.005421    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-workload-socket\") pod \"1d85cafc-0f17-463f-a993-48d4a9c918c4\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") "
Nov 04 01:41:13.005558 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.005526    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-credential-socket\") pod \"1d85cafc-0f17-463f-a993-48d4a9c918c4\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") "
Nov 04 01:41:13.005609 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.005549    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-workload-socket" pod "d46129f1-9405-4d08-aa5a-59ab37046d40" (UID: "d46129f1-9405-4d08-aa5a-59ab37046d40"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:41:13.005824 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.005786    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-workload-socket" pod "1d85cafc-0f17-463f-a993-48d4a9c918c4" (UID: "1d85cafc-0f17-463f-a993-48d4a9c918c4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:41:13.005824 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.005807    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-credential-socket" pod "1d85cafc-0f17-463f-a993-48d4a9c918c4" (UID: "1d85cafc-0f17-463f-a993-48d4a9c918c4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:41:13.006039 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.005850    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-credential-socket\") pod \"d46129f1-9405-4d08-aa5a-59ab37046d40\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") "
Nov 04 01:41:13.006039 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.005881    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1d85cafc-0f17-463f-a993-48d4a9c918c4-kube-api-access-mbw4n\" (UniqueName: \"kubernetes.io/projected/1d85cafc-0f17-463f-a993-48d4a9c918c4-kube-api-access-mbw4n\") pod \"1d85cafc-0f17-463f-a993-48d4a9c918c4\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") "
Nov 04 01:41:13.006039 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.005910    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-workload-certs\") pod \"d46129f1-9405-4d08-aa5a-59ab37046d40\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") "
Nov 04 01:41:13.006039 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.005950    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1d85cafc-0f17-463f-a993-48d4a9c918c4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d85cafc-0f17-463f-a993-48d4a9c918c4-istiod-ca-cert\") pod \"1d85cafc-0f17-463f-a993-48d4a9c918c4\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") "
Nov 04 01:41:13.006039 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.006029    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-podinfo\") pod \"d46129f1-9405-4d08-aa5a-59ab37046d40\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") "
Nov 04 01:41:13.006313 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.006077    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-data\") pod \"1d85cafc-0f17-463f-a993-48d4a9c918c4\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") "
Nov 04 01:41:13.006313 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.006111    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-data\") pod \"d46129f1-9405-4d08-aa5a-59ab37046d40\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") "
Nov 04 01:41:13.006313 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.006119    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-credential-socket" pod "d46129f1-9405-4d08-aa5a-59ab37046d40" (UID: "d46129f1-9405-4d08-aa5a-59ab37046d40"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:41:13.006313 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.006150    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d46129f1-9405-4d08-aa5a-59ab37046d40-kube-api-access-ww64f\" (UniqueName: \"kubernetes.io/projected/d46129f1-9405-4d08-aa5a-59ab37046d40-kube-api-access-ww64f\") pod \"d46129f1-9405-4d08-aa5a-59ab37046d40\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") "
Nov 04 01:41:13.006313 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.006192    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-envoy\") pod \"d46129f1-9405-4d08-aa5a-59ab37046d40\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") "
Nov 04 01:41:13.006313 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.006237    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d46129f1-9405-4d08-aa5a-59ab37046d40-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d46129f1-9405-4d08-aa5a-59ab37046d40-istiod-ca-cert\") pod \"d46129f1-9405-4d08-aa5a-59ab37046d40\" (UID: \"d46129f1-9405-4d08-aa5a-59ab37046d40\") "
Nov 04 01:41:13.006313 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.006210    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-workload-certs" pod "d46129f1-9405-4d08-aa5a-59ab37046d40" (UID: "d46129f1-9405-4d08-aa5a-59ab37046d40"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:41:13.006313 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.006267    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-workload-certs\") pod \"1d85cafc-0f17-463f-a993-48d4a9c918c4\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") "
Nov 04 01:41:13.006714 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.006321    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-envoy\") pod \"1d85cafc-0f17-463f-a993-48d4a9c918c4\" (UID: \"1d85cafc-0f17-463f-a993-48d4a9c918c4\") "
Nov 04 01:41:13.006714 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.006368    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d85cafc-0f17-463f-a993-48d4a9c918c4-istiod-ca-cert" pod "1d85cafc-0f17-463f-a993-48d4a9c918c4" (UID: "1d85cafc-0f17-463f-a993-48d4a9c918c4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:41:13.006820 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.006743    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d46129f1-9405-4d08-aa5a-59ab37046d40-istiod-ca-cert" pod "d46129f1-9405-4d08-aa5a-59ab37046d40" (UID: "d46129f1-9405-4d08-aa5a-59ab37046d40"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:41:13.007118 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.006889    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-workload-certs" pod "1d85cafc-0f17-463f-a993-48d4a9c918c4" (UID: "1d85cafc-0f17-463f-a993-48d4a9c918c4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:41:13.007118 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.007095    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-data" pod "d46129f1-9405-4d08-aa5a-59ab37046d40" (UID: "d46129f1-9405-4d08-aa5a-59ab37046d40"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:41:13.007118 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.007101    5640 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-workload-socket\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.007332 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.007154    5640 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-credential-socket\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.007332 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.007172    5640 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-credential-socket\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.007332 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.007104    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-data" pod "1d85cafc-0f17-463f-a993-48d4a9c918c4" (UID: "1d85cafc-0f17-463f-a993-48d4a9c918c4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:41:13.007332 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.007190    5640 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-workload-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.007332 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.007225    5640 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d85cafc-0f17-463f-a993-48d4a9c918c4-istiod-ca-cert\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.007332 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.007242    5640 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d46129f1-9405-4d08-aa5a-59ab37046d40-istiod-ca-cert\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.007332 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.007258    5640 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-workload-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.007332 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.007275    5640 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-workload-socket\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.008266 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.008132    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-podinfo" pod "1d85cafc-0f17-463f-a993-48d4a9c918c4" (UID: "1d85cafc-0f17-463f-a993-48d4a9c918c4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 01:41:13.008266 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.008221    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d85cafc-0f17-463f-a993-48d4a9c918c4-kube-api-access-mbw4n" pod "1d85cafc-0f17-463f-a993-48d4a9c918c4" (UID: "1d85cafc-0f17-463f-a993-48d4a9c918c4"). InnerVolumeSpecName "kube-api-access-mbw4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:41:13.008266 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.008238    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-token" pod "1d85cafc-0f17-463f-a993-48d4a9c918c4" (UID: "1d85cafc-0f17-463f-a993-48d4a9c918c4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:41:13.008689 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.008662    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-token" pod "d46129f1-9405-4d08-aa5a-59ab37046d40" (UID: "d46129f1-9405-4d08-aa5a-59ab37046d40"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:41:13.009137 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.009115    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-envoy" pod "1d85cafc-0f17-463f-a993-48d4a9c918c4" (UID: "1d85cafc-0f17-463f-a993-48d4a9c918c4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:41:13.009246 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.009230    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d46129f1-9405-4d08-aa5a-59ab37046d40-kube-api-access-ww64f" pod "d46129f1-9405-4d08-aa5a-59ab37046d40" (UID: "d46129f1-9405-4d08-aa5a-59ab37046d40"). InnerVolumeSpecName "kube-api-access-ww64f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:41:13.009379 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.009362    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-envoy" pod "d46129f1-9405-4d08-aa5a-59ab37046d40" (UID: "d46129f1-9405-4d08-aa5a-59ab37046d40"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:41:13.009558 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.009545    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-podinfo" pod "d46129f1-9405-4d08-aa5a-59ab37046d40" (UID: "d46129f1-9405-4d08-aa5a-59ab37046d40"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 01:41:13.108090 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.108055    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbw4n\" (UniqueName: \"kubernetes.io/projected/1d85cafc-0f17-463f-a993-48d4a9c918c4-kube-api-access-mbw4n\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.108090 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.108084    5640 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-podinfo\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.108090 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.108098    5640 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-data\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.108334 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.108107    5640 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-data\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.108334 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.108117    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ww64f\" (UniqueName: \"kubernetes.io/projected/d46129f1-9405-4d08-aa5a-59ab37046d40-kube-api-access-ww64f\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.108334 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.108125    5640 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-envoy\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.108334 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.108133    5640 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-envoy\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.108334 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.108142    5640 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-token\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.108334 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.108149    5640 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d46129f1-9405-4d08-aa5a-59ab37046d40-istio-token\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.108334 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.108163    5640 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d85cafc-0f17-463f-a993-48d4a9c918c4-istio-podinfo\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.838412 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.838330    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"
Nov 04 01:41:13.838412 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.838356    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc" event={"ID":"1d85cafc-0f17-463f-a993-48d4a9c918c4","Type":"ContainerDied","Data":"6431598bdeec18cacda894fbbdd085eb40fc9501481726bb9511f5cf9e1046d2"}
Nov 04 01:41:13.838920 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.838424    5640 scope.go:122] "RemoveContainer" containerID="fdcd7a9ae95936988138c0b09511070f734fe12b545fdc4e06069038b9772ec5"
Nov 04 01:41:13.839879 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.839855    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6" event={"ID":"d46129f1-9405-4d08-aa5a-59ab37046d40","Type":"ContainerDied","Data":"d214c2893001dc817f4bdafaf7d0ecadfcdc0b75b7ce783c07210160bd74f5a1"}
Nov 04 01:41:13.839963 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.839917    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"
Nov 04 01:41:13.848574 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:13.848553    5640 scope.go:122] "RemoveContainer" containerID="27234bb3f943669b7a016c9669bdd580b05704686c464a530ad3e0bd7858a06a"
Nov 04 01:41:14.008923 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:14.008887    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"]
Nov 04 01:41:14.060678 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:14.060643    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-cwhb6"]
Nov 04 01:41:14.126275 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:14.126193    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"]
Nov 04 01:41:14.130221 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:14.130191    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-sdbwc"]
Nov 04 01:41:15.566474 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:15.566438    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1d85cafc-0f17-463f-a993-48d4a9c918c4" path="/var/lib/kubelet/pods/1d85cafc-0f17-463f-a993-48d4a9c918c4/volumes"
Nov 04 01:41:15.566912 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:41:15.566898    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d46129f1-9405-4d08-aa5a-59ab37046d40" path="/var/lib/kubelet/pods/d46129f1-9405-4d08-aa5a-59ab37046d40/volumes"
Nov 04 01:41:41.142636 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:41:41.142600    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:42:11.142112 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:42:11.142075    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:42:23.661185 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:23.661152    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"]
Nov 04 01:42:23.661619 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:23.661366    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz" podUID="c4dcd59b-b937-4fa4-a11c-23f2b746d724" containerName="discovery" containerID="cri-o://241f67a06be9d20df73e435b7f10d92768916ecc0c746ca3f5132bbc4978fd1e" gracePeriod=30
Nov 04 01:42:23.921619 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:23.921551    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:42:23.973653 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:23.973613    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c4dcd59b-b937-4fa4-a11c-23f2b746d724-kube-api-access-cxnsr\" (UniqueName: \"kubernetes.io/projected/c4dcd59b-b937-4fa4-a11c-23f2b746d724-kube-api-access-cxnsr\") pod \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") "
Nov 04 01:42:23.973852 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:23.973677    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-kubeconfig\") pod \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") "
Nov 04 01:42:23.973852 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:23.973804    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c4dcd59b-b937-4fa4-a11c-23f2b746d724-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4dcd59b-b937-4fa4-a11c-23f2b746d724-local-certs\") pod \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") "
Nov 04 01:42:23.974016 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:23.973886    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c4dcd59b-b937-4fa4-a11c-23f2b746d724-cacerts\" (UniqueName: \"kubernetes.io/secret/c4dcd59b-b937-4fa4-a11c-23f2b746d724-cacerts\") pod \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") "
Nov 04 01:42:23.974016 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:23.973948    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-csr-dns-cert\") pod \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") "
Nov 04 01:42:23.974016 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:23.973996    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-csr-ca-configmap\") pod \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") "
Nov 04 01:42:23.974172 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:23.974038    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-token\" (UniqueName: \"kubernetes.io/projected/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-token\") pod \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\" (UID: \"c4dcd59b-b937-4fa4-a11c-23f2b746d724\") "
Nov 04 01:42:23.974450 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:23.974421    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-csr-ca-configmap" pod "c4dcd59b-b937-4fa4-a11c-23f2b746d724" (UID: "c4dcd59b-b937-4fa4-a11c-23f2b746d724"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:42:23.976370 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:23.976346    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4dcd59b-b937-4fa4-a11c-23f2b746d724-local-certs" pod "c4dcd59b-b937-4fa4-a11c-23f2b746d724" (UID: "c4dcd59b-b937-4fa4-a11c-23f2b746d724"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:42:23.976520 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:23.976500    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-token" pod "c4dcd59b-b937-4fa4-a11c-23f2b746d724" (UID: "c4dcd59b-b937-4fa4-a11c-23f2b746d724"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:42:23.976574 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:23.976556    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4dcd59b-b937-4fa4-a11c-23f2b746d724-cacerts" pod "c4dcd59b-b937-4fa4-a11c-23f2b746d724" (UID: "c4dcd59b-b937-4fa4-a11c-23f2b746d724"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:42:23.976613 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:23.976576    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-kubeconfig" pod "c4dcd59b-b937-4fa4-a11c-23f2b746d724" (UID: "c4dcd59b-b937-4fa4-a11c-23f2b746d724"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:42:23.976613 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:23.976577    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4dcd59b-b937-4fa4-a11c-23f2b746d724-kube-api-access-cxnsr" pod "c4dcd59b-b937-4fa4-a11c-23f2b746d724" (UID: "c4dcd59b-b937-4fa4-a11c-23f2b746d724"). InnerVolumeSpecName "kube-api-access-cxnsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:42:23.977011 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:23.976952    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-csr-dns-cert" pod "c4dcd59b-b937-4fa4-a11c-23f2b746d724" (UID: "c4dcd59b-b937-4fa4-a11c-23f2b746d724"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:42:24.075571 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:24.075533    5640 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-csr-dns-cert\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:42:24.075571 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:24.075564    5640 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-csr-ca-configmap\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:42:24.075571 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:24.075576    5640 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-token\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:42:24.075809 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:24.075585    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxnsr\" (UniqueName: \"kubernetes.io/projected/c4dcd59b-b937-4fa4-a11c-23f2b746d724-kube-api-access-cxnsr\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:42:24.075809 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:24.075594    5640 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c4dcd59b-b937-4fa4-a11c-23f2b746d724-istio-kubeconfig\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:42:24.075809 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:24.075602    5640 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4dcd59b-b937-4fa4-a11c-23f2b746d724-local-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:42:24.075809 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:24.075611    5640 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c4dcd59b-b937-4fa4-a11c-23f2b746d724-cacerts\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:42:24.226656 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:24.226564    5640 generic.go:356] "Generic (PLEG): container finished" podID="c4dcd59b-b937-4fa4-a11c-23f2b746d724" containerID="241f67a06be9d20df73e435b7f10d92768916ecc0c746ca3f5132bbc4978fd1e" exitCode=0
Nov 04 01:42:24.226656 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:24.226616    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"
Nov 04 01:42:24.226919 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:24.226654    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz" event={"ID":"c4dcd59b-b937-4fa4-a11c-23f2b746d724","Type":"ContainerDied","Data":"241f67a06be9d20df73e435b7f10d92768916ecc0c746ca3f5132bbc4978fd1e"}
Nov 04 01:42:24.226919 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:24.226713    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz" event={"ID":"c4dcd59b-b937-4fa4-a11c-23f2b746d724","Type":"ContainerDied","Data":"223c98e96f2a30fe2489979063a5b2195f206a16b230db7e30426fee828c8a76"}
Nov 04 01:42:24.226919 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:24.226740    5640 scope.go:122] "RemoveContainer" containerID="241f67a06be9d20df73e435b7f10d92768916ecc0c746ca3f5132bbc4978fd1e"
Nov 04 01:42:24.237108 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:24.237088    5640 scope.go:122] "RemoveContainer" containerID="241f67a06be9d20df73e435b7f10d92768916ecc0c746ca3f5132bbc4978fd1e"
Nov 04 01:42:24.237400 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:42:24.237383    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"241f67a06be9d20df73e435b7f10d92768916ecc0c746ca3f5132bbc4978fd1e\": container with ID starting with 241f67a06be9d20df73e435b7f10d92768916ecc0c746ca3f5132bbc4978fd1e not found: ID does not exist" containerID="241f67a06be9d20df73e435b7f10d92768916ecc0c746ca3f5132bbc4978fd1e"
Nov 04 01:42:24.237459 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:24.237409    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"241f67a06be9d20df73e435b7f10d92768916ecc0c746ca3f5132bbc4978fd1e"} err="failed to get container status \"241f67a06be9d20df73e435b7f10d92768916ecc0c746ca3f5132bbc4978fd1e\": rpc error: code = NotFound desc = could not find container \"241f67a06be9d20df73e435b7f10d92768916ecc0c746ca3f5132bbc4978fd1e\": container with ID starting with 241f67a06be9d20df73e435b7f10d92768916ecc0c746ca3f5132bbc4978fd1e not found: ID does not exist"
Nov 04 01:42:24.396586 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:24.396549    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"]
Nov 04 01:42:24.400291 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:24.400261    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2jpkz"]
Nov 04 01:42:25.565144 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:42:25.565113    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c4dcd59b-b937-4fa4-a11c-23f2b746d724" path="/var/lib/kubelet/pods/c4dcd59b-b937-4fa4-a11c-23f2b746d724/volumes"
Nov 04 01:42:41.141438 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:42:41.141398    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:43:11.141651 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:43:11.141573    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:43:41.142252 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:43:41.142215    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:44:11.140811 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:44:11.140769    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:44:41.141363 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:44:41.141323    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:45:11.141797 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:45:11.141754    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:45:41.141098 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:45:41.141056    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:46:11.142439 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:46:11.142399    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:46:32.861426 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:32.861394    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"]
Nov 04 01:46:32.861907 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:32.861622    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv" podUID="65a6272a-e527-4b6c-b7cf-760b742e41c9" containerName="istio-proxy" containerID="cri-o://7966dff5996b0431a60ddd42d9ed203f9c2a9c3d211a1ef12af9990f777fde99" gracePeriod=30
Nov 04 01:46:32.907624 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:32.907594    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"]
Nov 04 01:46:32.907844 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:32.907818    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6" podUID="1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a" containerName="istio-proxy" containerID="cri-o://f214991954acc682e3298c53a02917503b222a6dbc4f011e877c120ab150c350" gracePeriod=30
Nov 04 01:46:32.909428 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:32.909407    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"]
Nov 04 01:46:32.909587 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:32.909557    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt" podUID="3006ea70-cf33-45cc-9321-1ba3daa5bea9" containerName="istio-proxy" containerID="cri-o://6b7a6a2315052a5ced4b9f9dfda1b2600b7fee5149682f313aa06ae4605d51fb" gracePeriod=30
Nov 04 01:46:37.130832 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:37.130787    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 01:46:37.131207 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:37.130862    5640 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6" podUID="1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 01:46:38.169407 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.169380    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:46:38.197291 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.197269    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:46:38.206302 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.206281    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:46:38.286711 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.286673    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-workload-certs\") pod \"65a6272a-e527-4b6c-b7cf-760b742e41c9\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") "
Nov 04 01:46:38.286711 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.286718    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-envoy\") pod \"65a6272a-e527-4b6c-b7cf-760b742e41c9\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") "
Nov 04 01:46:38.286935 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.286738    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-credential-socket\") pod \"65a6272a-e527-4b6c-b7cf-760b742e41c9\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") "
Nov 04 01:46:38.286935 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.286773    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-workload-socket\") pod \"65a6272a-e527-4b6c-b7cf-760b742e41c9\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") "
Nov 04 01:46:38.286935 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.286809    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-token\" (UniqueName: \"kubernetes.io/projected/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-token\") pod \"65a6272a-e527-4b6c-b7cf-760b742e41c9\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") "
Nov 04 01:46:38.286935 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.286911    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/65a6272a-e527-4b6c-b7cf-760b742e41c9-kube-api-access-d5sw5\" (UniqueName: \"kubernetes.io/projected/65a6272a-e527-4b6c-b7cf-760b742e41c9-kube-api-access-d5sw5\") pod \"65a6272a-e527-4b6c-b7cf-760b742e41c9\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") "
Nov 04 01:46:38.287169 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.287018    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/65a6272a-e527-4b6c-b7cf-760b742e41c9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65a6272a-e527-4b6c-b7cf-760b742e41c9-istiod-ca-cert\") pod \"65a6272a-e527-4b6c-b7cf-760b742e41c9\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") "
Nov 04 01:46:38.287169 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.287031    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-workload-certs" pod "65a6272a-e527-4b6c-b7cf-760b742e41c9" (UID: "65a6272a-e527-4b6c-b7cf-760b742e41c9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.287169 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.287101    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-credential-socket" pod "65a6272a-e527-4b6c-b7cf-760b742e41c9" (UID: "65a6272a-e527-4b6c-b7cf-760b742e41c9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.287169 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.287120    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-data\") pod \"65a6272a-e527-4b6c-b7cf-760b742e41c9\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") "
Nov 04 01:46:38.287169 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.287119    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-workload-socket" pod "65a6272a-e527-4b6c-b7cf-760b742e41c9" (UID: "65a6272a-e527-4b6c-b7cf-760b742e41c9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.287169 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.287155    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-podinfo\") pod \"65a6272a-e527-4b6c-b7cf-760b742e41c9\" (UID: \"65a6272a-e527-4b6c-b7cf-760b742e41c9\") "
Nov 04 01:46:38.287485 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.287349    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-data" pod "65a6272a-e527-4b6c-b7cf-760b742e41c9" (UID: "65a6272a-e527-4b6c-b7cf-760b742e41c9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.287485 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.287432    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65a6272a-e527-4b6c-b7cf-760b742e41c9-istiod-ca-cert" pod "65a6272a-e527-4b6c-b7cf-760b742e41c9" (UID: "65a6272a-e527-4b6c-b7cf-760b742e41c9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:46:38.287677 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.287658    5640 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-workload-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.287738 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.287684    5640 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-credential-socket\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.287738 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.287698    5640 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-workload-socket\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.287738 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.287712    5640 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65a6272a-e527-4b6c-b7cf-760b742e41c9-istiod-ca-cert\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.287738 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.287726    5640 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-data\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.289107 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.289081    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-envoy" pod "65a6272a-e527-4b6c-b7cf-760b742e41c9" (UID: "65a6272a-e527-4b6c-b7cf-760b742e41c9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.289215 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.289118    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-token" pod "65a6272a-e527-4b6c-b7cf-760b742e41c9" (UID: "65a6272a-e527-4b6c-b7cf-760b742e41c9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:46:38.289215 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.289149    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-podinfo" pod "65a6272a-e527-4b6c-b7cf-760b742e41c9" (UID: "65a6272a-e527-4b6c-b7cf-760b742e41c9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 01:46:38.289215 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.289152    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65a6272a-e527-4b6c-b7cf-760b742e41c9-kube-api-access-d5sw5" pod "65a6272a-e527-4b6c-b7cf-760b742e41c9" (UID: "65a6272a-e527-4b6c-b7cf-760b742e41c9"). InnerVolumeSpecName "kube-api-access-d5sw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:46:38.388268 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.388238    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-credential-socket\") pod \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") "
Nov 04 01:46:38.388268 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.388269    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-envoy\") pod \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") "
Nov 04 01:46:38.388521 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.388293    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3006ea70-cf33-45cc-9321-1ba3daa5bea9-kube-api-access-bshw2\" (UniqueName: \"kubernetes.io/projected/3006ea70-cf33-45cc-9321-1ba3daa5bea9-kube-api-access-bshw2\") pod \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") "
Nov 04 01:46:38.388521 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.388310    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-workload-socket\") pod \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") "
Nov 04 01:46:38.388521 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.388345    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-data\") pod \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") "
Nov 04 01:46:38.388521 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.388368    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istiod-ca-cert\") pod \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") "
Nov 04 01:46:38.388521 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.388407    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-token\" (UniqueName: \"kubernetes.io/projected/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-token\") pod \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") "
Nov 04 01:46:38.388521 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.388432    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-envoy\") pod \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") "
Nov 04 01:46:38.388521 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.388468    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-credential-socket\") pod \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") "
Nov 04 01:46:38.388521 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.388499    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-podinfo\") pod \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") "
Nov 04 01:46:38.388936 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.388551    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-podinfo\") pod \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") "
Nov 04 01:46:38.388936 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.388616    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-data\") pod \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") "
Nov 04 01:46:38.388936 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.388597    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-credential-socket" pod "3006ea70-cf33-45cc-9321-1ba3daa5bea9" (UID: "3006ea70-cf33-45cc-9321-1ba3daa5bea9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.388936 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.388676    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-workload-certs\") pod \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") "
Nov 04 01:46:38.388936 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.388679    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-data" pod "1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a" (UID: "1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.388936 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.388707    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istiod-ca-cert\") pod \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") "
Nov 04 01:46:38.388936 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.388727    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-workload-certs\") pod \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") "
Nov 04 01:46:38.388936 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.388789    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-workload-socket\") pod \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") "
Nov 04 01:46:38.388936 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.388815    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-kube-api-access-fmxnk\" (UniqueName: \"kubernetes.io/projected/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-kube-api-access-fmxnk\") pod \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\" (UID: \"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a\") "
Nov 04 01:46:38.388936 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.388845    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-token\" (UniqueName: \"kubernetes.io/projected/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-token\") pod \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\" (UID: \"3006ea70-cf33-45cc-9321-1ba3daa5bea9\") "
Nov 04 01:46:38.388936 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.388929    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istiod-ca-cert" pod "3006ea70-cf33-45cc-9321-1ba3daa5bea9" (UID: "3006ea70-cf33-45cc-9321-1ba3daa5bea9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:46:38.389494 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.389069    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-credential-socket" pod "1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a" (UID: "1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.389494 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.389224    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-workload-socket" pod "3006ea70-cf33-45cc-9321-1ba3daa5bea9" (UID: "3006ea70-cf33-45cc-9321-1ba3daa5bea9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.389494 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.389351    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-data" pod "3006ea70-cf33-45cc-9321-1ba3daa5bea9" (UID: "3006ea70-cf33-45cc-9321-1ba3daa5bea9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.389494 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.389369    5640 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-podinfo\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.389494 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.389389    5640 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-credential-socket\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.389494 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.389404    5640 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-workload-socket\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.389494 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.389417    5640 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-data\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.389494 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.389432    5640 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istiod-ca-cert\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.389494 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.389447    5640 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-envoy\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.389494 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.389461    5640 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65a6272a-e527-4b6c-b7cf-760b742e41c9-istio-token\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.389494 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.389477    5640 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-credential-socket\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.389494 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.389491    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5sw5\" (UniqueName: \"kubernetes.io/projected/65a6272a-e527-4b6c-b7cf-760b742e41c9-kube-api-access-d5sw5\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.390509 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.389593    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-workload-certs" pod "3006ea70-cf33-45cc-9321-1ba3daa5bea9" (UID: "3006ea70-cf33-45cc-9321-1ba3daa5bea9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.390509 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.389660    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-workload-socket" pod "1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a" (UID: "1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.390509 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.389858    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-workload-certs" pod "1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a" (UID: "1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.390509 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.389908    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istiod-ca-cert" pod "1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a" (UID: "1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:46:38.391731 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.391704    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-token" pod "3006ea70-cf33-45cc-9321-1ba3daa5bea9" (UID: "3006ea70-cf33-45cc-9321-1ba3daa5bea9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:46:38.391868 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.391847    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-token" pod "1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a" (UID: "1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:46:38.391998 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.391865    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-podinfo" pod "1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a" (UID: "1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 01:46:38.391998 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.391942    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-kube-api-access-fmxnk" pod "1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a" (UID: "1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a"). InnerVolumeSpecName "kube-api-access-fmxnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:46:38.392625 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.392601    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3006ea70-cf33-45cc-9321-1ba3daa5bea9-kube-api-access-bshw2" pod "3006ea70-cf33-45cc-9321-1ba3daa5bea9" (UID: "3006ea70-cf33-45cc-9321-1ba3daa5bea9"). InnerVolumeSpecName "kube-api-access-bshw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:46:38.392871 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.392854    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-envoy" pod "1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a" (UID: "1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.393105 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.393086    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-envoy" pod "3006ea70-cf33-45cc-9321-1ba3daa5bea9" (UID: "3006ea70-cf33-45cc-9321-1ba3daa5bea9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.393323 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.393300    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-podinfo" pod "3006ea70-cf33-45cc-9321-1ba3daa5bea9" (UID: "3006ea70-cf33-45cc-9321-1ba3daa5bea9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 01:46:38.490541 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.490460    5640 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-token\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.490541 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.490491    5640 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-envoy\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.490541 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.490501    5640 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istio-podinfo\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.490541 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.490509    5640 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-podinfo\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.490541 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.490519    5640 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-data\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.490541 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.490527    5640 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-workload-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.490541 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.490537    5640 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-istiod-ca-cert\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.490541 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.490544    5640 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-workload-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.491131 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.490553    5640 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-workload-socket\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.491131 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.490568    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmxnk\" (UniqueName: \"kubernetes.io/projected/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a-kube-api-access-fmxnk\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.491131 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.490578    5640 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-token\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.491131 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.490585    5640 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3006ea70-cf33-45cc-9321-1ba3daa5bea9-istio-envoy\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.491131 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.490593    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bshw2\" (UniqueName: \"kubernetes.io/projected/3006ea70-cf33-45cc-9321-1ba3daa5bea9-kube-api-access-bshw2\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.531586 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.531555    5640 generic.go:356] "Generic (PLEG): container finished" podID="1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a" containerID="f214991954acc682e3298c53a02917503b222a6dbc4f011e877c120ab150c350" exitCode=0
Nov 04 01:46:38.531731 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.531611    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"
Nov 04 01:46:38.531731 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.531636    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6" event={"ID":"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a","Type":"ContainerDied","Data":"f214991954acc682e3298c53a02917503b222a6dbc4f011e877c120ab150c350"}
Nov 04 01:46:38.531731 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.531691    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6" event={"ID":"1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a","Type":"ContainerDied","Data":"f058dc6240d7147455b0c7af83427c80e3ccab236824dff67f8fa8522d1d6718"}
Nov 04 01:46:38.531731 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.531711    5640 scope.go:122] "RemoveContainer" containerID="f214991954acc682e3298c53a02917503b222a6dbc4f011e877c120ab150c350"
Nov 04 01:46:38.533087 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.533065    5640 generic.go:356] "Generic (PLEG): container finished" podID="3006ea70-cf33-45cc-9321-1ba3daa5bea9" containerID="6b7a6a2315052a5ced4b9f9dfda1b2600b7fee5149682f313aa06ae4605d51fb" exitCode=0
Nov 04 01:46:38.533198 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.533137    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"
Nov 04 01:46:38.533198 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.533174    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt" event={"ID":"3006ea70-cf33-45cc-9321-1ba3daa5bea9","Type":"ContainerDied","Data":"6b7a6a2315052a5ced4b9f9dfda1b2600b7fee5149682f313aa06ae4605d51fb"}
Nov 04 01:46:38.533307 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.533225    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt" event={"ID":"3006ea70-cf33-45cc-9321-1ba3daa5bea9","Type":"ContainerDied","Data":"c951efc9c4bbff689d75560f7844de79fe533887228f632c3e42b803f26b2646"}
Nov 04 01:46:38.534686 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.534662    5640 generic.go:356] "Generic (PLEG): container finished" podID="65a6272a-e527-4b6c-b7cf-760b742e41c9" containerID="7966dff5996b0431a60ddd42d9ed203f9c2a9c3d211a1ef12af9990f777fde99" exitCode=0
Nov 04 01:46:38.534843 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.534712    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"
Nov 04 01:46:38.534843 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.534782    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv" event={"ID":"65a6272a-e527-4b6c-b7cf-760b742e41c9","Type":"ContainerDied","Data":"7966dff5996b0431a60ddd42d9ed203f9c2a9c3d211a1ef12af9990f777fde99"}
Nov 04 01:46:38.534989 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.534850    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv" event={"ID":"65a6272a-e527-4b6c-b7cf-760b742e41c9","Type":"ContainerDied","Data":"583cf9b0820aef4f6743e951fe0b1eb4e5e7a4fcae81dbe4fe98029bf168c0c9"}
Nov 04 01:46:38.545932 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.545917    5640 scope.go:122] "RemoveContainer" containerID="f214991954acc682e3298c53a02917503b222a6dbc4f011e877c120ab150c350"
Nov 04 01:46:38.546341 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:46:38.546320    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f214991954acc682e3298c53a02917503b222a6dbc4f011e877c120ab150c350\": container with ID starting with f214991954acc682e3298c53a02917503b222a6dbc4f011e877c120ab150c350 not found: ID does not exist" containerID="f214991954acc682e3298c53a02917503b222a6dbc4f011e877c120ab150c350"
Nov 04 01:46:38.546439 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.546346    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f214991954acc682e3298c53a02917503b222a6dbc4f011e877c120ab150c350"} err="failed to get container status \"f214991954acc682e3298c53a02917503b222a6dbc4f011e877c120ab150c350\": rpc error: code = NotFound desc = could not find container \"f214991954acc682e3298c53a02917503b222a6dbc4f011e877c120ab150c350\": container with ID starting with f214991954acc682e3298c53a02917503b222a6dbc4f011e877c120ab150c350 not found: ID does not exist"
Nov 04 01:46:38.546439 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.546364    5640 scope.go:122] "RemoveContainer" containerID="6b7a6a2315052a5ced4b9f9dfda1b2600b7fee5149682f313aa06ae4605d51fb"
Nov 04 01:46:38.554899 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.554884    5640 scope.go:122] "RemoveContainer" containerID="6b7a6a2315052a5ced4b9f9dfda1b2600b7fee5149682f313aa06ae4605d51fb"
Nov 04 01:46:38.555178 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:46:38.555161    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b7a6a2315052a5ced4b9f9dfda1b2600b7fee5149682f313aa06ae4605d51fb\": container with ID starting with 6b7a6a2315052a5ced4b9f9dfda1b2600b7fee5149682f313aa06ae4605d51fb not found: ID does not exist" containerID="6b7a6a2315052a5ced4b9f9dfda1b2600b7fee5149682f313aa06ae4605d51fb"
Nov 04 01:46:38.555232 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.555185    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b7a6a2315052a5ced4b9f9dfda1b2600b7fee5149682f313aa06ae4605d51fb"} err="failed to get container status \"6b7a6a2315052a5ced4b9f9dfda1b2600b7fee5149682f313aa06ae4605d51fb\": rpc error: code = NotFound desc = could not find container \"6b7a6a2315052a5ced4b9f9dfda1b2600b7fee5149682f313aa06ae4605d51fb\": container with ID starting with 6b7a6a2315052a5ced4b9f9dfda1b2600b7fee5149682f313aa06ae4605d51fb not found: ID does not exist"
Nov 04 01:46:38.555232 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.555200    5640 scope.go:122] "RemoveContainer" containerID="7966dff5996b0431a60ddd42d9ed203f9c2a9c3d211a1ef12af9990f777fde99"
Nov 04 01:46:38.563540 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.563519    5640 scope.go:122] "RemoveContainer" containerID="7966dff5996b0431a60ddd42d9ed203f9c2a9c3d211a1ef12af9990f777fde99"
Nov 04 01:46:38.563919 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:46:38.563896    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7966dff5996b0431a60ddd42d9ed203f9c2a9c3d211a1ef12af9990f777fde99\": container with ID starting with 7966dff5996b0431a60ddd42d9ed203f9c2a9c3d211a1ef12af9990f777fde99 not found: ID does not exist" containerID="7966dff5996b0431a60ddd42d9ed203f9c2a9c3d211a1ef12af9990f777fde99"
Nov 04 01:46:38.564087 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.563927    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7966dff5996b0431a60ddd42d9ed203f9c2a9c3d211a1ef12af9990f777fde99"} err="failed to get container status \"7966dff5996b0431a60ddd42d9ed203f9c2a9c3d211a1ef12af9990f777fde99\": rpc error: code = NotFound desc = could not find container \"7966dff5996b0431a60ddd42d9ed203f9c2a9c3d211a1ef12af9990f777fde99\": container with ID starting with 7966dff5996b0431a60ddd42d9ed203f9c2a9c3d211a1ef12af9990f777fde99 not found: ID does not exist"
Nov 04 01:46:38.670275 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.670245    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"]
Nov 04 01:46:38.676286 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.676261    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt"]
Nov 04 01:46:38.778585 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.778558    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"]
Nov 04 01:46:38.784710 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.784687    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-q6lf6"]
Nov 04 01:46:38.887787 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.887751    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"]
Nov 04 01:46:38.894238 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:38.894211    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-gh8zv"]
Nov 04 01:46:39.193912 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:39.193830    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 01:46:39.193912 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:39.193885    5640 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-t9ljt" podUID="3006ea70-cf33-45cc-9321-1ba3daa5bea9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 01:46:39.564337 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:39.564304    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a" path="/var/lib/kubelet/pods/1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a/volumes"
Nov 04 01:46:39.564876 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:39.564861    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3006ea70-cf33-45cc-9321-1ba3daa5bea9" path="/var/lib/kubelet/pods/3006ea70-cf33-45cc-9321-1ba3daa5bea9/volumes"
Nov 04 01:46:39.565418 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:46:39.565404    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="65a6272a-e527-4b6c-b7cf-760b742e41c9" path="/var/lib/kubelet/pods/65a6272a-e527-4b6c-b7cf-760b742e41c9/volumes"
Nov 04 01:46:41.139427 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:46:41.139392    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:47:11.142210 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:47:11.142098    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:47:25.309317 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:25.309281    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t"]
Nov 04 01:47:25.419134 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:25.419105    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc"]
Nov 04 01:47:30.137716 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.137633    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"]
Nov 04 01:47:30.138107 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.137872    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8" podUID="8fa1c474-6c77-4525-9b7a-b24b5fef9d99" containerName="maas-api" containerID="cri-o://bc0b8186507835bbaa4b367dfce2a0f5da1c40d1e703a8e13bc6a39643f239fa" gracePeriod=30
Nov 04 01:47:30.312648 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.310234    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t" podUID="38461a5c-026f-4c65-b681-a51255299c29" containerName="payload-processing" containerID="cri-o://8987fc0baf6f5d48fc1854274aeaec510cf3b6abb9cdcb3b986ddf6d450dcd8a" gracePeriod=25
Nov 04 01:47:30.420139 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.420092    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc" podUID="34fc7aa2-9592-4115-933f-7dc0ad90b21f" containerName="payload-pre-processing" containerID="cri-o://36fc4d88b3a55c3f561176338852e1a49aede53a37018b3b4addb8277432dd25" gracePeriod=25
Nov 04 01:47:30.496395 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.496367    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"
Nov 04 01:47:30.548466 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.548427    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t"
Nov 04 01:47:30.629386 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.629350    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-metrics-certs\") pod \"8fa1c474-6c77-4525-9b7a-b24b5fef9d99\" (UID: \"8fa1c474-6c77-4525-9b7a-b24b5fef9d99\") "
Nov 04 01:47:30.629535 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.629486    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/38461a5c-026f-4c65-b681-a51255299c29-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38461a5c-026f-4c65-b681-a51255299c29-plugins-config-volume\") pod \"38461a5c-026f-4c65-b681-a51255299c29\" (UID: \"38461a5c-026f-4c65-b681-a51255299c29\") "
Nov 04 01:47:30.629618 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.629539    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-maas-api-tls\") pod \"8fa1c474-6c77-4525-9b7a-b24b5fef9d99\" (UID: \"8fa1c474-6c77-4525-9b7a-b24b5fef9d99\") "
Nov 04 01:47:30.629618 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.629571    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-openshift-service-ca\") pod \"8fa1c474-6c77-4525-9b7a-b24b5fef9d99\" (UID: \"8fa1c474-6c77-4525-9b7a-b24b5fef9d99\") "
Nov 04 01:47:30.629731 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.629666    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/38461a5c-026f-4c65-b681-a51255299c29-kube-api-access-pc425\" (UniqueName: \"kubernetes.io/projected/38461a5c-026f-4c65-b681-a51255299c29-kube-api-access-pc425\") pod \"38461a5c-026f-4c65-b681-a51255299c29\" (UID: \"38461a5c-026f-4c65-b681-a51255299c29\") "
Nov 04 01:47:30.629731 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.629697    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-kube-api-access-9hv92\" (UniqueName: \"kubernetes.io/projected/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-kube-api-access-9hv92\") pod \"8fa1c474-6c77-4525-9b7a-b24b5fef9d99\" (UID: \"8fa1c474-6c77-4525-9b7a-b24b5fef9d99\") "
Nov 04 01:47:30.629962 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.629934    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38461a5c-026f-4c65-b681-a51255299c29-plugins-config-volume" pod "38461a5c-026f-4c65-b681-a51255299c29" (UID: "38461a5c-026f-4c65-b681-a51255299c29"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:47:30.630196 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.630176    5640 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38461a5c-026f-4c65-b681-a51255299c29-plugins-config-volume\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:47:30.630741 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.630718    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-openshift-service-ca" pod "8fa1c474-6c77-4525-9b7a-b24b5fef9d99" (UID: "8fa1c474-6c77-4525-9b7a-b24b5fef9d99"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:47:30.636881 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.635736    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-metrics-certs" pod "8fa1c474-6c77-4525-9b7a-b24b5fef9d99" (UID: "8fa1c474-6c77-4525-9b7a-b24b5fef9d99"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:47:30.636881 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.635753    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38461a5c-026f-4c65-b681-a51255299c29-kube-api-access-pc425" pod "38461a5c-026f-4c65-b681-a51255299c29" (UID: "38461a5c-026f-4c65-b681-a51255299c29"). InnerVolumeSpecName "kube-api-access-pc425". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:47:30.636881 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.635773    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-kube-api-access-9hv92" pod "8fa1c474-6c77-4525-9b7a-b24b5fef9d99" (UID: "8fa1c474-6c77-4525-9b7a-b24b5fef9d99"). InnerVolumeSpecName "kube-api-access-9hv92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:47:30.639211 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.639181    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-maas-api-tls" pod "8fa1c474-6c77-4525-9b7a-b24b5fef9d99" (UID: "8fa1c474-6c77-4525-9b7a-b24b5fef9d99"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:47:30.682062 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.682037    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc"
Nov 04 01:47:30.731230 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.731193    5640 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-maas-api-tls\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:47:30.731230 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.731232    5640 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-openshift-service-ca\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:47:30.731230 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.731246    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pc425\" (UniqueName: \"kubernetes.io/projected/38461a5c-026f-4c65-b681-a51255299c29-kube-api-access-pc425\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:47:30.731557 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.731259    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hv92\" (UniqueName: \"kubernetes.io/projected/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-kube-api-access-9hv92\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:47:30.731557 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.731272    5640 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fa1c474-6c77-4525-9b7a-b24b5fef9d99-metrics-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:47:30.810568 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.810533    5640 generic.go:356] "Generic (PLEG): container finished" podID="8fa1c474-6c77-4525-9b7a-b24b5fef9d99" containerID="bc0b8186507835bbaa4b367dfce2a0f5da1c40d1e703a8e13bc6a39643f239fa" exitCode=0
Nov 04 01:47:30.810763 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.810610    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"
Nov 04 01:47:30.810763 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.810612    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8" event={"ID":"8fa1c474-6c77-4525-9b7a-b24b5fef9d99","Type":"ContainerDied","Data":"bc0b8186507835bbaa4b367dfce2a0f5da1c40d1e703a8e13bc6a39643f239fa"}
Nov 04 01:47:30.810763 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.810713    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8" event={"ID":"8fa1c474-6c77-4525-9b7a-b24b5fef9d99","Type":"ContainerDied","Data":"7340c30acab7c8f7b29572f4807a475b4105e4627d52419ee66a15a975e859be"}
Nov 04 01:47:30.810763 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.810735    5640 scope.go:122] "RemoveContainer" containerID="bc0b8186507835bbaa4b367dfce2a0f5da1c40d1e703a8e13bc6a39643f239fa"
Nov 04 01:47:30.812017 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.811998    5640 generic.go:356] "Generic (PLEG): container finished" podID="34fc7aa2-9592-4115-933f-7dc0ad90b21f" containerID="36fc4d88b3a55c3f561176338852e1a49aede53a37018b3b4addb8277432dd25" exitCode=0
Nov 04 01:47:30.812106 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.812026    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc" event={"ID":"34fc7aa2-9592-4115-933f-7dc0ad90b21f","Type":"ContainerDied","Data":"36fc4d88b3a55c3f561176338852e1a49aede53a37018b3b4addb8277432dd25"}
Nov 04 01:47:30.812106 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.812058    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc"
Nov 04 01:47:30.812106 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.812067    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc" event={"ID":"34fc7aa2-9592-4115-933f-7dc0ad90b21f","Type":"ContainerDied","Data":"11b2a2832e431fcf5889d0e9598699a7fcde41801b5c985d0e5879db417eabb1"}
Nov 04 01:47:30.813728 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.813703    5640 generic.go:356] "Generic (PLEG): container finished" podID="38461a5c-026f-4c65-b681-a51255299c29" containerID="8987fc0baf6f5d48fc1854274aeaec510cf3b6abb9cdcb3b986ddf6d450dcd8a" exitCode=0
Nov 04 01:47:30.813860 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.813758    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t" event={"ID":"38461a5c-026f-4c65-b681-a51255299c29","Type":"ContainerDied","Data":"8987fc0baf6f5d48fc1854274aeaec510cf3b6abb9cdcb3b986ddf6d450dcd8a"}
Nov 04 01:47:30.813860 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.813798    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t" event={"ID":"38461a5c-026f-4c65-b681-a51255299c29","Type":"ContainerDied","Data":"469b74cce6ea1b57ab86c6af969ac7ecc25ca4e90be47628a6a751cad8738a5c"}
Nov 04 01:47:30.813860 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.813761    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t"
Nov 04 01:47:30.821137 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.821112    5640 scope.go:122] "RemoveContainer" containerID="bc0b8186507835bbaa4b367dfce2a0f5da1c40d1e703a8e13bc6a39643f239fa"
Nov 04 01:47:30.821432 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:47:30.821414    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc0b8186507835bbaa4b367dfce2a0f5da1c40d1e703a8e13bc6a39643f239fa\": container with ID starting with bc0b8186507835bbaa4b367dfce2a0f5da1c40d1e703a8e13bc6a39643f239fa not found: ID does not exist" containerID="bc0b8186507835bbaa4b367dfce2a0f5da1c40d1e703a8e13bc6a39643f239fa"
Nov 04 01:47:30.821517 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.821446    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc0b8186507835bbaa4b367dfce2a0f5da1c40d1e703a8e13bc6a39643f239fa"} err="failed to get container status \"bc0b8186507835bbaa4b367dfce2a0f5da1c40d1e703a8e13bc6a39643f239fa\": rpc error: code = NotFound desc = could not find container \"bc0b8186507835bbaa4b367dfce2a0f5da1c40d1e703a8e13bc6a39643f239fa\": container with ID starting with bc0b8186507835bbaa4b367dfce2a0f5da1c40d1e703a8e13bc6a39643f239fa not found: ID does not exist"
Nov 04 01:47:30.821517 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.821470    5640 scope.go:122] "RemoveContainer" containerID="36fc4d88b3a55c3f561176338852e1a49aede53a37018b3b4addb8277432dd25"
Nov 04 01:47:30.829620 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.829602    5640 scope.go:122] "RemoveContainer" containerID="36fc4d88b3a55c3f561176338852e1a49aede53a37018b3b4addb8277432dd25"
Nov 04 01:47:30.829852 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:47:30.829833    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36fc4d88b3a55c3f561176338852e1a49aede53a37018b3b4addb8277432dd25\": container with ID starting with 36fc4d88b3a55c3f561176338852e1a49aede53a37018b3b4addb8277432dd25 not found: ID does not exist" containerID="36fc4d88b3a55c3f561176338852e1a49aede53a37018b3b4addb8277432dd25"
Nov 04 01:47:30.829908 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.829863    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36fc4d88b3a55c3f561176338852e1a49aede53a37018b3b4addb8277432dd25"} err="failed to get container status \"36fc4d88b3a55c3f561176338852e1a49aede53a37018b3b4addb8277432dd25\": rpc error: code = NotFound desc = could not find container \"36fc4d88b3a55c3f561176338852e1a49aede53a37018b3b4addb8277432dd25\": container with ID starting with 36fc4d88b3a55c3f561176338852e1a49aede53a37018b3b4addb8277432dd25 not found: ID does not exist"
Nov 04 01:47:30.829908 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.829882    5640 scope.go:122] "RemoveContainer" containerID="8987fc0baf6f5d48fc1854274aeaec510cf3b6abb9cdcb3b986ddf6d450dcd8a"
Nov 04 01:47:30.832167 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.832147    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/34fc7aa2-9592-4115-933f-7dc0ad90b21f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34fc7aa2-9592-4115-933f-7dc0ad90b21f-plugins-config-volume\") pod \"34fc7aa2-9592-4115-933f-7dc0ad90b21f\" (UID: \"34fc7aa2-9592-4115-933f-7dc0ad90b21f\") "
Nov 04 01:47:30.832242 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.832201    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/34fc7aa2-9592-4115-933f-7dc0ad90b21f-kube-api-access-f2496\" (UniqueName: \"kubernetes.io/projected/34fc7aa2-9592-4115-933f-7dc0ad90b21f-kube-api-access-f2496\") pod \"34fc7aa2-9592-4115-933f-7dc0ad90b21f\" (UID: \"34fc7aa2-9592-4115-933f-7dc0ad90b21f\") "
Nov 04 01:47:30.832474 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.832452    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34fc7aa2-9592-4115-933f-7dc0ad90b21f-plugins-config-volume" pod "34fc7aa2-9592-4115-933f-7dc0ad90b21f" (UID: "34fc7aa2-9592-4115-933f-7dc0ad90b21f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:47:30.834227 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.834208    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34fc7aa2-9592-4115-933f-7dc0ad90b21f-kube-api-access-f2496" pod "34fc7aa2-9592-4115-933f-7dc0ad90b21f" (UID: "34fc7aa2-9592-4115-933f-7dc0ad90b21f"). InnerVolumeSpecName "kube-api-access-f2496". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:47:30.838014 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.837989    5640 scope.go:122] "RemoveContainer" containerID="8987fc0baf6f5d48fc1854274aeaec510cf3b6abb9cdcb3b986ddf6d450dcd8a"
Nov 04 01:47:30.838308 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:47:30.838288    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8987fc0baf6f5d48fc1854274aeaec510cf3b6abb9cdcb3b986ddf6d450dcd8a\": container with ID starting with 8987fc0baf6f5d48fc1854274aeaec510cf3b6abb9cdcb3b986ddf6d450dcd8a not found: ID does not exist" containerID="8987fc0baf6f5d48fc1854274aeaec510cf3b6abb9cdcb3b986ddf6d450dcd8a"
Nov 04 01:47:30.838371 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.838317    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8987fc0baf6f5d48fc1854274aeaec510cf3b6abb9cdcb3b986ddf6d450dcd8a"} err="failed to get container status \"8987fc0baf6f5d48fc1854274aeaec510cf3b6abb9cdcb3b986ddf6d450dcd8a\": rpc error: code = NotFound desc = could not find container \"8987fc0baf6f5d48fc1854274aeaec510cf3b6abb9cdcb3b986ddf6d450dcd8a\": container with ID starting with 8987fc0baf6f5d48fc1854274aeaec510cf3b6abb9cdcb3b986ddf6d450dcd8a not found: ID does not exist"
Nov 04 01:47:30.933691 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.933598    5640 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34fc7aa2-9592-4115-933f-7dc0ad90b21f-plugins-config-volume\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:47:30.933691 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.933631    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2496\" (UniqueName: \"kubernetes.io/projected/34fc7aa2-9592-4115-933f-7dc0ad90b21f-kube-api-access-f2496\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:47:30.945174 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.945142    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"]
Nov 04 01:47:30.952311 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:30.952282    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-b1047d-65c5949cc8-f76c8"]
Nov 04 01:47:31.054911 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:31.054876    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t"]
Nov 04 01:47:31.059453 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:31.059424    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-b1047d-68b886648-jmz6t"]
Nov 04 01:47:31.227795 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:31.227709    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc"]
Nov 04 01:47:31.231473 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:31.231444    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-b1047d-5b8bbd9947-kkkkc"]
Nov 04 01:47:31.564205 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:31.564168    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="34fc7aa2-9592-4115-933f-7dc0ad90b21f" path="/var/lib/kubelet/pods/34fc7aa2-9592-4115-933f-7dc0ad90b21f/volumes"
Nov 04 01:47:31.564694 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:31.564678    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="38461a5c-026f-4c65-b681-a51255299c29" path="/var/lib/kubelet/pods/38461a5c-026f-4c65-b681-a51255299c29/volumes"
Nov 04 01:47:31.565199 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:31.565185    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8fa1c474-6c77-4525-9b7a-b24b5fef9d99" path="/var/lib/kubelet/pods/8fa1c474-6c77-4525-9b7a-b24b5fef9d99/volumes"
Nov 04 01:47:33.353296 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353263    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"]
Nov 04 01:47:33.353726 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353678    5640 cpu_manager.go:414] "containerMap: removing container" podUID="1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a" containerName="istio-proxy"
Nov 04 01:47:33.353726 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353690    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a" containerName="istio-proxy"
Nov 04 01:47:33.353726 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353702    5640 cpu_manager.go:414] "containerMap: removing container" podUID="34fc7aa2-9592-4115-933f-7dc0ad90b21f" containerName="payload-pre-processing"
Nov 04 01:47:33.353726 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353707    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="34fc7aa2-9592-4115-933f-7dc0ad90b21f" containerName="payload-pre-processing"
Nov 04 01:47:33.353726 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353719    5640 cpu_manager.go:414] "containerMap: removing container" podUID="8fa1c474-6c77-4525-9b7a-b24b5fef9d99" containerName="maas-api"
Nov 04 01:47:33.353726 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353724    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8fa1c474-6c77-4525-9b7a-b24b5fef9d99" containerName="maas-api"
Nov 04 01:47:33.353914 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353733    5640 cpu_manager.go:414] "containerMap: removing container" podUID="65a6272a-e527-4b6c-b7cf-760b742e41c9" containerName="istio-proxy"
Nov 04 01:47:33.353914 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353738    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="65a6272a-e527-4b6c-b7cf-760b742e41c9" containerName="istio-proxy"
Nov 04 01:47:33.353914 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353750    5640 cpu_manager.go:414] "containerMap: removing container" podUID="d46129f1-9405-4d08-aa5a-59ab37046d40" containerName="istio-proxy"
Nov 04 01:47:33.353914 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353755    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d46129f1-9405-4d08-aa5a-59ab37046d40" containerName="istio-proxy"
Nov 04 01:47:33.353914 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353764    5640 cpu_manager.go:414] "containerMap: removing container" podUID="c4dcd59b-b937-4fa4-a11c-23f2b746d724" containerName="discovery"
Nov 04 01:47:33.353914 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353769    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c4dcd59b-b937-4fa4-a11c-23f2b746d724" containerName="discovery"
Nov 04 01:47:33.353914 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353777    5640 cpu_manager.go:414] "containerMap: removing container" podUID="38461a5c-026f-4c65-b681-a51255299c29" containerName="payload-processing"
Nov 04 01:47:33.353914 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353782    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="38461a5c-026f-4c65-b681-a51255299c29" containerName="payload-processing"
Nov 04 01:47:33.353914 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353792    5640 cpu_manager.go:414] "containerMap: removing container" podUID="1d85cafc-0f17-463f-a993-48d4a9c918c4" containerName="istio-proxy"
Nov 04 01:47:33.353914 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353797    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1d85cafc-0f17-463f-a993-48d4a9c918c4" containerName="istio-proxy"
Nov 04 01:47:33.353914 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353815    5640 cpu_manager.go:414] "containerMap: removing container" podUID="3006ea70-cf33-45cc-9321-1ba3daa5bea9" containerName="istio-proxy"
Nov 04 01:47:33.353914 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353821    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3006ea70-cf33-45cc-9321-1ba3daa5bea9" containerName="istio-proxy"
Nov 04 01:47:33.353914 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353875    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="3006ea70-cf33-45cc-9321-1ba3daa5bea9" containerName="istio-proxy"
Nov 04 01:47:33.353914 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353885    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="e678048d-06f8-4101-85e2-b0c5d125238a" containerName="istio-proxy"
Nov 04 01:47:33.353914 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353891    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="1a0bbdfa-19b8-4bb5-ab32-2f3cb008bb5a" containerName="istio-proxy"
Nov 04 01:47:33.353914 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353898    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="3a3a0f69-18a0-4089-a37e-2034c873bde6" containerName="istio-proxy"
Nov 04 01:47:33.353914 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353904    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="34fc7aa2-9592-4115-933f-7dc0ad90b21f" containerName="payload-pre-processing"
Nov 04 01:47:33.353914 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353909    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="8fa1c474-6c77-4525-9b7a-b24b5fef9d99" containerName="maas-api"
Nov 04 01:47:33.353914 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353914    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="65a6272a-e527-4b6c-b7cf-760b742e41c9" containerName="istio-proxy"
Nov 04 01:47:33.353914 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353919    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="d46129f1-9405-4d08-aa5a-59ab37046d40" containerName="istio-proxy"
Nov 04 01:47:33.354531 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353925    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="c4dcd59b-b937-4fa4-a11c-23f2b746d724" containerName="discovery"
Nov 04 01:47:33.354531 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353931    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="38461a5c-026f-4c65-b681-a51255299c29" containerName="payload-processing"
Nov 04 01:47:33.354531 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.353937    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="1d85cafc-0f17-463f-a993-48d4a9c918c4" containerName="istio-proxy"
Nov 04 01:47:33.358600 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.358572    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.407875 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.407844    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-kcfvk\""
Nov 04 01:47:33.456069 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.456036    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"]
Nov 04 01:47:33.459981 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.459932    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dda960a4-2bd3-40bd-b9f4-992e6df421f4-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.460138 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.460071    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dda960a4-2bd3-40bd-b9f4-992e6df421f4-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.460206 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.460129    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxt5f\" (UniqueName: \"kubernetes.io/projected/dda960a4-2bd3-40bd-b9f4-992e6df421f4-kube-api-access-wxt5f\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.460206 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.460165    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dda960a4-2bd3-40bd-b9f4-992e6df421f4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.460311 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.460269    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dda960a4-2bd3-40bd-b9f4-992e6df421f4-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.460359 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.460346    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dda960a4-2bd3-40bd-b9f4-992e6df421f4-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.460464 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.460391    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dda960a4-2bd3-40bd-b9f4-992e6df421f4-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.460464 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.460440    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dda960a4-2bd3-40bd-b9f4-992e6df421f4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.460556 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.460469    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dda960a4-2bd3-40bd-b9f4-992e6df421f4-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.561320 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.561291    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dda960a4-2bd3-40bd-b9f4-992e6df421f4-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.561320 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.561324    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dda960a4-2bd3-40bd-b9f4-992e6df421f4-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.561570 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.561357    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dda960a4-2bd3-40bd-b9f4-992e6df421f4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.561570 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.561399    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dda960a4-2bd3-40bd-b9f4-992e6df421f4-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.561570 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.561458    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dda960a4-2bd3-40bd-b9f4-992e6df421f4-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.561570 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.561510    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dda960a4-2bd3-40bd-b9f4-992e6df421f4-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.561570 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.561537    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxt5f\" (UniqueName: \"kubernetes.io/projected/dda960a4-2bd3-40bd-b9f4-992e6df421f4-kube-api-access-wxt5f\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.561570 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.561571    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dda960a4-2bd3-40bd-b9f4-992e6df421f4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.561892 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.561627    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dda960a4-2bd3-40bd-b9f4-992e6df421f4-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.561892 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.561737    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dda960a4-2bd3-40bd-b9f4-992e6df421f4-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.561892 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.561843    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dda960a4-2bd3-40bd-b9f4-992e6df421f4-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.561892 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.561861    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dda960a4-2bd3-40bd-b9f4-992e6df421f4-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.562071 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.562012    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dda960a4-2bd3-40bd-b9f4-992e6df421f4-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.562404 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.562385    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dda960a4-2bd3-40bd-b9f4-992e6df421f4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.564419 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.564396    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dda960a4-2bd3-40bd-b9f4-992e6df421f4-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.564521 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.564436    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dda960a4-2bd3-40bd-b9f4-992e6df421f4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.619288 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.619213    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dda960a4-2bd3-40bd-b9f4-992e6df421f4-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.619288 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.619262    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxt5f\" (UniqueName: \"kubernetes.io/projected/dda960a4-2bd3-40bd-b9f4-992e6df421f4-kube-api-access-wxt5f\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-78bvs\" (UID: \"dda960a4-2bd3-40bd-b9f4-992e6df421f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:33.672011 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:33.671964    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:34.098137 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:34.098094    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"]
Nov 04 01:47:34.105315 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:47:34.105285    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddda960a4_2bd3_40bd_b9f4_992e6df421f4.slice/crio-851cd351b7b500c7ce6e8efc57c505da8d95344bba3e673789ea669f77c7455a WatchSource:0}: Error finding container 851cd351b7b500c7ce6e8efc57c505da8d95344bba3e673789ea669f77c7455a: Status 404 returned error can't find the container with id 851cd351b7b500c7ce6e8efc57c505da8d95344bba3e673789ea669f77c7455a
Nov 04 01:47:34.107601 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:34.107567    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:47:34.107679 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:34.107636    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:47:34.107679 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:34.107669    5640 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Nov 04 01:47:34.837370 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:34.837329    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs" event={"ID":"dda960a4-2bd3-40bd-b9f4-992e6df421f4","Type":"ContainerStarted","Data":"b4ad5efca1f23f4c72e57c5479830d4e05042d412341a207b3421f72ecdb534e"}
Nov 04 01:47:34.837780 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:34.837385    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs" event={"ID":"dda960a4-2bd3-40bd-b9f4-992e6df421f4","Type":"ContainerStarted","Data":"851cd351b7b500c7ce6e8efc57c505da8d95344bba3e673789ea669f77c7455a"}
Nov 04 01:47:34.997956 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:34.997899    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs" podStartSLOduration=1.997885205 podStartE2EDuration="1.997885205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:47:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:47:34.997407754 +0000 UTC m=+2177.549867895" watchObservedRunningTime="2026-11-04 01:47:34.997885205 +0000 UTC m=+2177.550345332"
Nov 04 01:47:35.672865 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:35.672815    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:35.674740 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:35.674707    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-78bvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Nov 04 01:47:35.674889 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:35.674771    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs" podUID="dda960a4-2bd3-40bd-b9f4-992e6df421f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Nov 04 01:47:36.672568 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:36.672521    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-78bvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Nov 04 01:47:36.673108 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:36.672585    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs" podUID="dda960a4-2bd3-40bd-b9f4-992e6df421f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Nov 04 01:47:37.673451 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:37.673411    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-78bvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Nov 04 01:47:37.673878 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:37.673480    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs" podUID="dda960a4-2bd3-40bd-b9f4-992e6df421f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Nov 04 01:47:38.672614 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:38.672574    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-78bvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Nov 04 01:47:38.672794 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:38.672633    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs" podUID="dda960a4-2bd3-40bd-b9f4-992e6df421f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Nov 04 01:47:39.672553 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:39.672514    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-78bvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Nov 04 01:47:39.673091 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:39.672585    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs" podUID="dda960a4-2bd3-40bd-b9f4-992e6df421f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Nov 04 01:47:40.672983 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:40.672939    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-78bvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Nov 04 01:47:40.673389 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:40.673031    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs" podUID="dda960a4-2bd3-40bd-b9f4-992e6df421f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Nov 04 01:47:41.141864 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:47:41.141817    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:47:41.673227 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:41.673189    5640 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-78bvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Nov 04 01:47:41.673659 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:41.673259    5640 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs" podUID="dda960a4-2bd3-40bd-b9f4-992e6df421f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Nov 04 01:47:42.870324 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:42.870290    5640 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:42.871049 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:42.871026    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:42.872022 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:42.871998    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-78bvs"
Nov 04 01:47:57.651432 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:57.651398    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"]
Nov 04 01:47:57.652057 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:57.651654    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp" podUID="a9102582-6a31-4a75-af3d-07d643d55a02" containerName="maas-api" containerID="cri-o://696b9aa325fce4c219170039384b104bf4d262d4e5e225038adab8c08d67a44b" gracePeriod=30
Nov 04 01:47:57.915246 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:57.915180    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"
Nov 04 01:47:57.982125 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:57.982092    5640 generic.go:356] "Generic (PLEG): container finished" podID="a9102582-6a31-4a75-af3d-07d643d55a02" containerID="696b9aa325fce4c219170039384b104bf4d262d4e5e225038adab8c08d67a44b" exitCode=0
Nov 04 01:47:57.982294 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:57.982142    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp" event={"ID":"a9102582-6a31-4a75-af3d-07d643d55a02","Type":"ContainerDied","Data":"696b9aa325fce4c219170039384b104bf4d262d4e5e225038adab8c08d67a44b"}
Nov 04 01:47:57.982294 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:57.982151    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"
Nov 04 01:47:57.982294 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:57.982184    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp" event={"ID":"a9102582-6a31-4a75-af3d-07d643d55a02","Type":"ContainerDied","Data":"7322e2be08f03652aa2298db862be7b14f1f379cd883c9a5bc5794657e277d51"}
Nov 04 01:47:57.982294 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:57.982205    5640 scope.go:122] "RemoveContainer" containerID="696b9aa325fce4c219170039384b104bf4d262d4e5e225038adab8c08d67a44b"
Nov 04 01:47:57.990875 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:57.990855    5640 scope.go:122] "RemoveContainer" containerID="a652a8358c64401645a60026a21a33a6c56a88588ad7bf4447200e436e3e9c90"
Nov 04 01:47:57.999116 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:57.999088    5640 scope.go:122] "RemoveContainer" containerID="696b9aa325fce4c219170039384b104bf4d262d4e5e225038adab8c08d67a44b"
Nov 04 01:47:57.999427 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:47:57.999409    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"696b9aa325fce4c219170039384b104bf4d262d4e5e225038adab8c08d67a44b\": container with ID starting with 696b9aa325fce4c219170039384b104bf4d262d4e5e225038adab8c08d67a44b not found: ID does not exist" containerID="696b9aa325fce4c219170039384b104bf4d262d4e5e225038adab8c08d67a44b"
Nov 04 01:47:57.999475 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:57.999438    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"696b9aa325fce4c219170039384b104bf4d262d4e5e225038adab8c08d67a44b"} err="failed to get container status \"696b9aa325fce4c219170039384b104bf4d262d4e5e225038adab8c08d67a44b\": rpc error: code = NotFound desc = could not find container \"696b9aa325fce4c219170039384b104bf4d262d4e5e225038adab8c08d67a44b\": container with ID starting with 696b9aa325fce4c219170039384b104bf4d262d4e5e225038adab8c08d67a44b not found: ID does not exist"
Nov 04 01:47:57.999475 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:57.999459    5640 scope.go:122] "RemoveContainer" containerID="a652a8358c64401645a60026a21a33a6c56a88588ad7bf4447200e436e3e9c90"
Nov 04 01:47:57.999758 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:47:57.999734    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a652a8358c64401645a60026a21a33a6c56a88588ad7bf4447200e436e3e9c90\": container with ID starting with a652a8358c64401645a60026a21a33a6c56a88588ad7bf4447200e436e3e9c90 not found: ID does not exist" containerID="a652a8358c64401645a60026a21a33a6c56a88588ad7bf4447200e436e3e9c90"
Nov 04 01:47:57.999850 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:57.999764    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a652a8358c64401645a60026a21a33a6c56a88588ad7bf4447200e436e3e9c90"} err="failed to get container status \"a652a8358c64401645a60026a21a33a6c56a88588ad7bf4447200e436e3e9c90\": rpc error: code = NotFound desc = could not find container \"a652a8358c64401645a60026a21a33a6c56a88588ad7bf4447200e436e3e9c90\": container with ID starting with a652a8358c64401645a60026a21a33a6c56a88588ad7bf4447200e436e3e9c90 not found: ID does not exist"
Nov 04 01:47:58.015374 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:58.015345    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a9102582-6a31-4a75-af3d-07d643d55a02-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9102582-6a31-4a75-af3d-07d643d55a02-metrics-certs\") pod \"a9102582-6a31-4a75-af3d-07d643d55a02\" (UID: \"a9102582-6a31-4a75-af3d-07d643d55a02\") "
Nov 04 01:47:58.015513 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:58.015385    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a9102582-6a31-4a75-af3d-07d643d55a02-kube-api-access-hg7x2\" (UniqueName: \"kubernetes.io/projected/a9102582-6a31-4a75-af3d-07d643d55a02-kube-api-access-hg7x2\") pod \"a9102582-6a31-4a75-af3d-07d643d55a02\" (UID: \"a9102582-6a31-4a75-af3d-07d643d55a02\") "
Nov 04 01:47:58.015513 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:58.015472    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a9102582-6a31-4a75-af3d-07d643d55a02-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9102582-6a31-4a75-af3d-07d643d55a02-maas-api-tls\") pod \"a9102582-6a31-4a75-af3d-07d643d55a02\" (UID: \"a9102582-6a31-4a75-af3d-07d643d55a02\") "
Nov 04 01:47:58.015513 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:58.015496    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a9102582-6a31-4a75-af3d-07d643d55a02-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9102582-6a31-4a75-af3d-07d643d55a02-openshift-service-ca\") pod \"a9102582-6a31-4a75-af3d-07d643d55a02\" (UID: \"a9102582-6a31-4a75-af3d-07d643d55a02\") "
Nov 04 01:47:58.015892 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:58.015860    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9102582-6a31-4a75-af3d-07d643d55a02-openshift-service-ca" pod "a9102582-6a31-4a75-af3d-07d643d55a02" (UID: "a9102582-6a31-4a75-af3d-07d643d55a02"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:47:58.017597 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:58.017570    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9102582-6a31-4a75-af3d-07d643d55a02-kube-api-access-hg7x2" pod "a9102582-6a31-4a75-af3d-07d643d55a02" (UID: "a9102582-6a31-4a75-af3d-07d643d55a02"). InnerVolumeSpecName "kube-api-access-hg7x2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:47:58.017597 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:58.017583    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9102582-6a31-4a75-af3d-07d643d55a02-metrics-certs" pod "a9102582-6a31-4a75-af3d-07d643d55a02" (UID: "a9102582-6a31-4a75-af3d-07d643d55a02"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:47:58.017713 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:58.017608    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9102582-6a31-4a75-af3d-07d643d55a02-maas-api-tls" pod "a9102582-6a31-4a75-af3d-07d643d55a02" (UID: "a9102582-6a31-4a75-af3d-07d643d55a02"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:47:58.116694 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:58.116651    5640 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9102582-6a31-4a75-af3d-07d643d55a02-metrics-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:47:58.116694 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:58.116686    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hg7x2\" (UniqueName: \"kubernetes.io/projected/a9102582-6a31-4a75-af3d-07d643d55a02-kube-api-access-hg7x2\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:47:58.116694 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:58.116700    5640 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9102582-6a31-4a75-af3d-07d643d55a02-maas-api-tls\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:47:58.116937 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:58.116713    5640 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9102582-6a31-4a75-af3d-07d643d55a02-openshift-service-ca\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:47:58.398099 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:58.398063    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"]
Nov 04 01:47:58.405402 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:58.405372    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-1225f3-6b98c4dcb6-f72zp"]
Nov 04 01:47:59.564310 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:47:59.564275    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a9102582-6a31-4a75-af3d-07d643d55a02" path="/var/lib/kubelet/pods/a9102582-6a31-4a75-af3d-07d643d55a02/volumes"
Nov 04 01:48:09.340259 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:09.340222    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"]
Nov 04 01:48:09.340660 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:09.340446    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh" podUID="31772fc6-bc9a-4d40-a587-914fffa131a6" containerName="istio-proxy" containerID="cri-o://7f769d7e510ea7a6fd18635d551c73e400f2c3c802fff39e7ae799f826b0cfa4" gracePeriod=30
Nov 04 01:48:11.142010 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:48:11.141955    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:48:14.603835 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.603800    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:48:14.686056 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.685955    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/31772fc6-bc9a-4d40-a587-914fffa131a6-kube-api-access-m8vwd\" (UniqueName: \"kubernetes.io/projected/31772fc6-bc9a-4d40-a587-914fffa131a6-kube-api-access-m8vwd\") pod \"31772fc6-bc9a-4d40-a587-914fffa131a6\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") "
Nov 04 01:48:14.686056 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.686022    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-podinfo\") pod \"31772fc6-bc9a-4d40-a587-914fffa131a6\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") "
Nov 04 01:48:14.686285 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.686057    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-workload-socket\") pod \"31772fc6-bc9a-4d40-a587-914fffa131a6\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") "
Nov 04 01:48:14.686285 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.686113    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-token\" (UniqueName: \"kubernetes.io/projected/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-token\") pod \"31772fc6-bc9a-4d40-a587-914fffa131a6\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") "
Nov 04 01:48:14.686285 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.686181    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-credential-socket\") pod \"31772fc6-bc9a-4d40-a587-914fffa131a6\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") "
Nov 04 01:48:14.686285 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.686209    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-workload-certs\") pod \"31772fc6-bc9a-4d40-a587-914fffa131a6\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") "
Nov 04 01:48:14.686285 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.686277    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-envoy\") pod \"31772fc6-bc9a-4d40-a587-914fffa131a6\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") "
Nov 04 01:48:14.686624 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.686310    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-data\") pod \"31772fc6-bc9a-4d40-a587-914fffa131a6\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") "
Nov 04 01:48:14.686624 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.686385    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/31772fc6-bc9a-4d40-a587-914fffa131a6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31772fc6-bc9a-4d40-a587-914fffa131a6-istiod-ca-cert\") pod \"31772fc6-bc9a-4d40-a587-914fffa131a6\" (UID: \"31772fc6-bc9a-4d40-a587-914fffa131a6\") "
Nov 04 01:48:14.686624 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.686444    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-workload-socket" pod "31772fc6-bc9a-4d40-a587-914fffa131a6" (UID: "31772fc6-bc9a-4d40-a587-914fffa131a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:48:14.686624 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.686520    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-workload-certs" pod "31772fc6-bc9a-4d40-a587-914fffa131a6" (UID: "31772fc6-bc9a-4d40-a587-914fffa131a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:48:14.686848 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.686684    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-credential-socket" pod "31772fc6-bc9a-4d40-a587-914fffa131a6" (UID: "31772fc6-bc9a-4d40-a587-914fffa131a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:48:14.686848 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.686716    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-data" pod "31772fc6-bc9a-4d40-a587-914fffa131a6" (UID: "31772fc6-bc9a-4d40-a587-914fffa131a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:48:14.686848 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.686797    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31772fc6-bc9a-4d40-a587-914fffa131a6-istiod-ca-cert" pod "31772fc6-bc9a-4d40-a587-914fffa131a6" (UID: "31772fc6-bc9a-4d40-a587-914fffa131a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:48:14.686848 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.686814    5640 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-data\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:14.686848 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.686837    5640 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-workload-socket\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:14.687140 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.686854    5640 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-credential-socket\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:14.687140 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.686868    5640 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-workload-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:14.688455 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.688429    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-token" pod "31772fc6-bc9a-4d40-a587-914fffa131a6" (UID: "31772fc6-bc9a-4d40-a587-914fffa131a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:48:14.688569 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.688459    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31772fc6-bc9a-4d40-a587-914fffa131a6-kube-api-access-m8vwd" pod "31772fc6-bc9a-4d40-a587-914fffa131a6" (UID: "31772fc6-bc9a-4d40-a587-914fffa131a6"). InnerVolumeSpecName "kube-api-access-m8vwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:48:14.688569 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.688474    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-podinfo" pod "31772fc6-bc9a-4d40-a587-914fffa131a6" (UID: "31772fc6-bc9a-4d40-a587-914fffa131a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 01:48:14.688569 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.688545    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-envoy" pod "31772fc6-bc9a-4d40-a587-914fffa131a6" (UID: "31772fc6-bc9a-4d40-a587-914fffa131a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:48:14.788280 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.788240    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8vwd\" (UniqueName: \"kubernetes.io/projected/31772fc6-bc9a-4d40-a587-914fffa131a6-kube-api-access-m8vwd\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:14.788280 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.788273    5640 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-podinfo\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:14.788280 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.788283    5640 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-token\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:14.788521 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.788291    5640 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31772fc6-bc9a-4d40-a587-914fffa131a6-istio-envoy\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:14.788521 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.788300    5640 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31772fc6-bc9a-4d40-a587-914fffa131a6-istiod-ca-cert\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:14.823594 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.823555    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"]
Nov 04 01:48:14.847982 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:14.847934    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"]
Nov 04 01:48:15.072262 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:15.072226    5640 generic.go:356] "Generic (PLEG): container finished" podID="31772fc6-bc9a-4d40-a587-914fffa131a6" containerID="7f769d7e510ea7a6fd18635d551c73e400f2c3c802fff39e7ae799f826b0cfa4" exitCode=0
Nov 04 01:48:15.072452 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:15.072282    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"
Nov 04 01:48:15.072452 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:15.072316    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh" event={"ID":"31772fc6-bc9a-4d40-a587-914fffa131a6","Type":"ContainerDied","Data":"7f769d7e510ea7a6fd18635d551c73e400f2c3c802fff39e7ae799f826b0cfa4"}
Nov 04 01:48:15.072452 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:15.072397    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh" event={"ID":"31772fc6-bc9a-4d40-a587-914fffa131a6","Type":"ContainerDied","Data":"9e7ad1736b2df559f6f82951570c4f8bc6ec76f680571054c88f318bb84f482f"}
Nov 04 01:48:15.072452 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:15.072422    5640 scope.go:122] "RemoveContainer" containerID="7f769d7e510ea7a6fd18635d551c73e400f2c3c802fff39e7ae799f826b0cfa4"
Nov 04 01:48:15.082389 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:15.082366    5640 scope.go:122] "RemoveContainer" containerID="3913e217e7f3d33bd23f79ce441b4af894c6342559f8eccb5b105b7bb8408e44"
Nov 04 01:48:15.090787 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:15.090762    5640 scope.go:122] "RemoveContainer" containerID="7f769d7e510ea7a6fd18635d551c73e400f2c3c802fff39e7ae799f826b0cfa4"
Nov 04 01:48:15.091095 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:48:15.091075    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f769d7e510ea7a6fd18635d551c73e400f2c3c802fff39e7ae799f826b0cfa4\": container with ID starting with 7f769d7e510ea7a6fd18635d551c73e400f2c3c802fff39e7ae799f826b0cfa4 not found: ID does not exist" containerID="7f769d7e510ea7a6fd18635d551c73e400f2c3c802fff39e7ae799f826b0cfa4"
Nov 04 01:48:15.091151 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:15.091106    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f769d7e510ea7a6fd18635d551c73e400f2c3c802fff39e7ae799f826b0cfa4"} err="failed to get container status \"7f769d7e510ea7a6fd18635d551c73e400f2c3c802fff39e7ae799f826b0cfa4\": rpc error: code = NotFound desc = could not find container \"7f769d7e510ea7a6fd18635d551c73e400f2c3c802fff39e7ae799f826b0cfa4\": container with ID starting with 7f769d7e510ea7a6fd18635d551c73e400f2c3c802fff39e7ae799f826b0cfa4 not found: ID does not exist"
Nov 04 01:48:15.091151 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:15.091127    5640 scope.go:122] "RemoveContainer" containerID="3913e217e7f3d33bd23f79ce441b4af894c6342559f8eccb5b105b7bb8408e44"
Nov 04 01:48:15.091383 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:48:15.091352    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3913e217e7f3d33bd23f79ce441b4af894c6342559f8eccb5b105b7bb8408e44\": container with ID starting with 3913e217e7f3d33bd23f79ce441b4af894c6342559f8eccb5b105b7bb8408e44 not found: ID does not exist" containerID="3913e217e7f3d33bd23f79ce441b4af894c6342559f8eccb5b105b7bb8408e44"
Nov 04 01:48:15.091423 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:15.091390    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3913e217e7f3d33bd23f79ce441b4af894c6342559f8eccb5b105b7bb8408e44"} err="failed to get container status \"3913e217e7f3d33bd23f79ce441b4af894c6342559f8eccb5b105b7bb8408e44\": rpc error: code = NotFound desc = could not find container \"3913e217e7f3d33bd23f79ce441b4af894c6342559f8eccb5b105b7bb8408e44\": container with ID starting with 3913e217e7f3d33bd23f79ce441b4af894c6342559f8eccb5b105b7bb8408e44 not found: ID does not exist"
Nov 04 01:48:15.226043 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:15.226008    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"]
Nov 04 01:48:15.230498 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:15.230472    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-b-1225f3-openshift-default-5d7dd5fb69-x5qkh"]
Nov 04 01:48:15.565091 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:15.565059    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="31772fc6-bc9a-4d40-a587-914fffa131a6" path="/var/lib/kubelet/pods/31772fc6-bc9a-4d40-a587-914fffa131a6/volumes"
Nov 04 01:48:23.520572 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:23.520530    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk"]
Nov 04 01:48:28.521429 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:28.521360    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk" podUID="88358137-e0c0-4b1b-8d07-a64187fcde9f" containerName="payload-pre-processing" containerID="cri-o://482bf16de352047ddd2e7387bb4967cf049cf81bec48aa5aafabca31ef4cda1c" gracePeriod=25
Nov 04 01:48:28.782477 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:28.782445    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk"
Nov 04 01:48:28.936279 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:28.936248    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/88358137-e0c0-4b1b-8d07-a64187fcde9f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88358137-e0c0-4b1b-8d07-a64187fcde9f-plugins-config-volume\") pod \"88358137-e0c0-4b1b-8d07-a64187fcde9f\" (UID: \"88358137-e0c0-4b1b-8d07-a64187fcde9f\") "
Nov 04 01:48:28.936452 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:28.936298    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/88358137-e0c0-4b1b-8d07-a64187fcde9f-kube-api-access-k8sbd\" (UniqueName: \"kubernetes.io/projected/88358137-e0c0-4b1b-8d07-a64187fcde9f-kube-api-access-k8sbd\") pod \"88358137-e0c0-4b1b-8d07-a64187fcde9f\" (UID: \"88358137-e0c0-4b1b-8d07-a64187fcde9f\") "
Nov 04 01:48:28.936620 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:28.936597    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88358137-e0c0-4b1b-8d07-a64187fcde9f-plugins-config-volume" pod "88358137-e0c0-4b1b-8d07-a64187fcde9f" (UID: "88358137-e0c0-4b1b-8d07-a64187fcde9f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:48:28.938453 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:28.938427    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88358137-e0c0-4b1b-8d07-a64187fcde9f-kube-api-access-k8sbd" pod "88358137-e0c0-4b1b-8d07-a64187fcde9f" (UID: "88358137-e0c0-4b1b-8d07-a64187fcde9f"). InnerVolumeSpecName "kube-api-access-k8sbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:48:29.037362 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:29.037265    5640 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88358137-e0c0-4b1b-8d07-a64187fcde9f-plugins-config-volume\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:29.037362 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:29.037302    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8sbd\" (UniqueName: \"kubernetes.io/projected/88358137-e0c0-4b1b-8d07-a64187fcde9f-kube-api-access-k8sbd\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:29.142518 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:29.142484    5640 generic.go:356] "Generic (PLEG): container finished" podID="88358137-e0c0-4b1b-8d07-a64187fcde9f" containerID="482bf16de352047ddd2e7387bb4967cf049cf81bec48aa5aafabca31ef4cda1c" exitCode=0
Nov 04 01:48:29.142716 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:29.142529    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk" event={"ID":"88358137-e0c0-4b1b-8d07-a64187fcde9f","Type":"ContainerDied","Data":"482bf16de352047ddd2e7387bb4967cf049cf81bec48aa5aafabca31ef4cda1c"}
Nov 04 01:48:29.142716 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:29.142549    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk"
Nov 04 01:48:29.142716 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:29.142623    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk" event={"ID":"88358137-e0c0-4b1b-8d07-a64187fcde9f","Type":"ContainerDied","Data":"48ca49fc334aab6a8f7aaaea2cb49d66586d13a86f0b96f909de00df6cb40455"}
Nov 04 01:48:29.142716 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:29.142647    5640 scope.go:122] "RemoveContainer" containerID="482bf16de352047ddd2e7387bb4967cf049cf81bec48aa5aafabca31ef4cda1c"
Nov 04 01:48:29.152102 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:29.152075    5640 scope.go:122] "RemoveContainer" containerID="482bf16de352047ddd2e7387bb4967cf049cf81bec48aa5aafabca31ef4cda1c"
Nov 04 01:48:29.152493 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:48:29.152468    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"482bf16de352047ddd2e7387bb4967cf049cf81bec48aa5aafabca31ef4cda1c\": container with ID starting with 482bf16de352047ddd2e7387bb4967cf049cf81bec48aa5aafabca31ef4cda1c not found: ID does not exist" containerID="482bf16de352047ddd2e7387bb4967cf049cf81bec48aa5aafabca31ef4cda1c"
Nov 04 01:48:29.152583 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:29.152497    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"482bf16de352047ddd2e7387bb4967cf049cf81bec48aa5aafabca31ef4cda1c"} err="failed to get container status \"482bf16de352047ddd2e7387bb4967cf049cf81bec48aa5aafabca31ef4cda1c\": rpc error: code = NotFound desc = could not find container \"482bf16de352047ddd2e7387bb4967cf049cf81bec48aa5aafabca31ef4cda1c\": container with ID starting with 482bf16de352047ddd2e7387bb4967cf049cf81bec48aa5aafabca31ef4cda1c not found: ID does not exist"
Nov 04 01:48:29.300061 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:29.299953    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk"]
Nov 04 01:48:29.346642 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:29.346606    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-a96a99-6576946687-h9wjk"]
Nov 04 01:48:29.564691 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:29.564611    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="88358137-e0c0-4b1b-8d07-a64187fcde9f" path="/var/lib/kubelet/pods/88358137-e0c0-4b1b-8d07-a64187fcde9f/volumes"
Nov 04 01:48:29.844200 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:29.844089    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l" podUID="d61eb43d-3fb7-4791-9c05-2521348481ba" containerName="main" containerID="cri-o://4f3548050f5e2b5e063c8470079de70ff98507ceb68bb822a002e109f967acb7" gracePeriod=45
Nov 04 01:48:29.867920 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:29.867890    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp" podUID="8bfedc7d-495f-4487-81fb-3ddfc319f084" containerName="main" containerID="cri-o://2b787072acc544f323e365858288f22c945f847576b1ee8070e955ff0e2835ed" gracePeriod=45
Nov 04 01:48:30.149241 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.149214    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:48:30.151228 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.151205    5640 generic.go:356] "Generic (PLEG): container finished" podID="8bfedc7d-495f-4487-81fb-3ddfc319f084" containerID="2b787072acc544f323e365858288f22c945f847576b1ee8070e955ff0e2835ed" exitCode=0
Nov 04 01:48:30.151354 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.151301    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp" event={"ID":"8bfedc7d-495f-4487-81fb-3ddfc319f084","Type":"ContainerDied","Data":"2b787072acc544f323e365858288f22c945f847576b1ee8070e955ff0e2835ed"}
Nov 04 01:48:30.151354 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.151334    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp" event={"ID":"8bfedc7d-495f-4487-81fb-3ddfc319f084","Type":"ContainerDied","Data":"2c8419df5bd1f79ab00f43bc79fa4be0f70517d13a424df694fca1fbee92131b"}
Nov 04 01:48:30.151354 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.151351    5640 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c8419df5bd1f79ab00f43bc79fa4be0f70517d13a424df694fca1fbee92131b"
Nov 04 01:48:30.152743 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.152718    5640 generic.go:356] "Generic (PLEG): container finished" podID="d61eb43d-3fb7-4791-9c05-2521348481ba" containerID="4f3548050f5e2b5e063c8470079de70ff98507ceb68bb822a002e109f967acb7" exitCode=0
Nov 04 01:48:30.152845 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.152753    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l" event={"ID":"d61eb43d-3fb7-4791-9c05-2521348481ba","Type":"ContainerDied","Data":"4f3548050f5e2b5e063c8470079de70ff98507ceb68bb822a002e109f967acb7"}
Nov 04 01:48:30.152845 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.152760    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"
Nov 04 01:48:30.152845 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.152784    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l" event={"ID":"d61eb43d-3fb7-4791-9c05-2521348481ba","Type":"ContainerDied","Data":"010e91d0dd9c0480ace9e903e2740c21dab6845584a801bdbb62cd3c254c017c"}
Nov 04 01:48:30.152845 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.152805    5640 scope.go:122] "RemoveContainer" containerID="4f3548050f5e2b5e063c8470079de70ff98507ceb68bb822a002e109f967acb7"
Nov 04 01:48:30.153162 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.153145    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:48:30.161399 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.161381    5640 scope.go:122] "RemoveContainer" containerID="4f3548050f5e2b5e063c8470079de70ff98507ceb68bb822a002e109f967acb7"
Nov 04 01:48:30.161743 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:48:30.161723    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f3548050f5e2b5e063c8470079de70ff98507ceb68bb822a002e109f967acb7\": container with ID starting with 4f3548050f5e2b5e063c8470079de70ff98507ceb68bb822a002e109f967acb7 not found: ID does not exist" containerID="4f3548050f5e2b5e063c8470079de70ff98507ceb68bb822a002e109f967acb7"
Nov 04 01:48:30.161849 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.161757    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f3548050f5e2b5e063c8470079de70ff98507ceb68bb822a002e109f967acb7"} err="failed to get container status \"4f3548050f5e2b5e063c8470079de70ff98507ceb68bb822a002e109f967acb7\": rpc error: code = NotFound desc = could not find container \"4f3548050f5e2b5e063c8470079de70ff98507ceb68bb822a002e109f967acb7\": container with ID starting with 4f3548050f5e2b5e063c8470079de70ff98507ceb68bb822a002e109f967acb7 not found: ID does not exist"
Nov 04 01:48:30.247607 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.247570    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8bfedc7d-495f-4487-81fb-3ddfc319f084-tls-certs\" (UniqueName: \"kubernetes.io/secret/8bfedc7d-495f-4487-81fb-3ddfc319f084-tls-certs\") pod \"8bfedc7d-495f-4487-81fb-3ddfc319f084\" (UID: \"8bfedc7d-495f-4487-81fb-3ddfc319f084\") "
Nov 04 01:48:30.247791 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.247612    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-dshm\" (UniqueName: \"kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-dshm\") pod \"d61eb43d-3fb7-4791-9c05-2521348481ba\" (UID: \"d61eb43d-3fb7-4791-9c05-2521348481ba\") "
Nov 04 01:48:30.247791 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.247670    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d61eb43d-3fb7-4791-9c05-2521348481ba-tls-certs\" (UniqueName: \"kubernetes.io/secret/d61eb43d-3fb7-4791-9c05-2521348481ba-tls-certs\") pod \"d61eb43d-3fb7-4791-9c05-2521348481ba\" (UID: \"d61eb43d-3fb7-4791-9c05-2521348481ba\") "
Nov 04 01:48:30.247791 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.247725    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-model-cache\") pod \"8bfedc7d-495f-4487-81fb-3ddfc319f084\" (UID: \"8bfedc7d-495f-4487-81fb-3ddfc319f084\") "
Nov 04 01:48:30.247791 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.247764    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8bfedc7d-495f-4487-81fb-3ddfc319f084-kube-api-access-8dd7b\" (UniqueName: \"kubernetes.io/projected/8bfedc7d-495f-4487-81fb-3ddfc319f084-kube-api-access-8dd7b\") pod \"8bfedc7d-495f-4487-81fb-3ddfc319f084\" (UID: \"8bfedc7d-495f-4487-81fb-3ddfc319f084\") "
Nov 04 01:48:30.248022 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.247795    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-home\" (UniqueName: \"kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-home\") pod \"8bfedc7d-495f-4487-81fb-3ddfc319f084\" (UID: \"8bfedc7d-495f-4487-81fb-3ddfc319f084\") "
Nov 04 01:48:30.248022 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.247827    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-tmp-dir\") pod \"8bfedc7d-495f-4487-81fb-3ddfc319f084\" (UID: \"8bfedc7d-495f-4487-81fb-3ddfc319f084\") "
Nov 04 01:48:30.248022 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.247856    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-model-cache\") pod \"d61eb43d-3fb7-4791-9c05-2521348481ba\" (UID: \"d61eb43d-3fb7-4791-9c05-2521348481ba\") "
Nov 04 01:48:30.248022 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.247893    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d61eb43d-3fb7-4791-9c05-2521348481ba-kube-api-access-45f98\" (UniqueName: \"kubernetes.io/projected/d61eb43d-3fb7-4791-9c05-2521348481ba-kube-api-access-45f98\") pod \"d61eb43d-3fb7-4791-9c05-2521348481ba\" (UID: \"d61eb43d-3fb7-4791-9c05-2521348481ba\") "
Nov 04 01:48:30.248022 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.247931    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-home\" (UniqueName: \"kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-home\") pod \"d61eb43d-3fb7-4791-9c05-2521348481ba\" (UID: \"d61eb43d-3fb7-4791-9c05-2521348481ba\") "
Nov 04 01:48:30.248022 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.248008    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-tmp-dir\") pod \"d61eb43d-3fb7-4791-9c05-2521348481ba\" (UID: \"d61eb43d-3fb7-4791-9c05-2521348481ba\") "
Nov 04 01:48:30.248322 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.248072    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-model-cache" pod "8bfedc7d-495f-4487-81fb-3ddfc319f084" (UID: "8bfedc7d-495f-4487-81fb-3ddfc319f084"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:48:30.248322 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.248092    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-dshm\") pod \"8bfedc7d-495f-4487-81fb-3ddfc319f084\" (UID: \"8bfedc7d-495f-4487-81fb-3ddfc319f084\") "
Nov 04 01:48:30.248322 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.248241    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-model-cache" pod "d61eb43d-3fb7-4791-9c05-2521348481ba" (UID: "d61eb43d-3fb7-4791-9c05-2521348481ba"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:48:30.248322 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.248302    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-home" pod "8bfedc7d-495f-4487-81fb-3ddfc319f084" (UID: "8bfedc7d-495f-4487-81fb-3ddfc319f084"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:48:30.248540 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.248491    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-tmp-dir" pod "8bfedc7d-495f-4487-81fb-3ddfc319f084" (UID: "8bfedc7d-495f-4487-81fb-3ddfc319f084"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:48:30.248607 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.248534    5640 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-model-cache\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:30.248607 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.248558    5640 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-home\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:30.248607 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.248574    5640 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-model-cache\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:30.248764 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.248644    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-home" pod "d61eb43d-3fb7-4791-9c05-2521348481ba" (UID: "d61eb43d-3fb7-4791-9c05-2521348481ba"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:48:30.248764 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.248665    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-tmp-dir" pod "d61eb43d-3fb7-4791-9c05-2521348481ba" (UID: "d61eb43d-3fb7-4791-9c05-2521348481ba"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:48:30.250582 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.250551    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d61eb43d-3fb7-4791-9c05-2521348481ba-tls-certs" pod "d61eb43d-3fb7-4791-9c05-2521348481ba" (UID: "d61eb43d-3fb7-4791-9c05-2521348481ba"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:48:30.250798 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.250769    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-dshm" pod "d61eb43d-3fb7-4791-9c05-2521348481ba" (UID: "d61eb43d-3fb7-4791-9c05-2521348481ba"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:48:30.250918 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.250797    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-dshm" pod "8bfedc7d-495f-4487-81fb-3ddfc319f084" (UID: "8bfedc7d-495f-4487-81fb-3ddfc319f084"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:48:30.251031 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.251012    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d61eb43d-3fb7-4791-9c05-2521348481ba-kube-api-access-45f98" pod "d61eb43d-3fb7-4791-9c05-2521348481ba" (UID: "d61eb43d-3fb7-4791-9c05-2521348481ba"). InnerVolumeSpecName "kube-api-access-45f98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:48:30.251031 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.251024    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bfedc7d-495f-4487-81fb-3ddfc319f084-tls-certs" pod "8bfedc7d-495f-4487-81fb-3ddfc319f084" (UID: "8bfedc7d-495f-4487-81fb-3ddfc319f084"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:48:30.251272 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.251254    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bfedc7d-495f-4487-81fb-3ddfc319f084-kube-api-access-8dd7b" pod "8bfedc7d-495f-4487-81fb-3ddfc319f084" (UID: "8bfedc7d-495f-4487-81fb-3ddfc319f084"). InnerVolumeSpecName "kube-api-access-8dd7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:48:30.349412 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.349377    5640 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-dshm\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:30.349412 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.349403    5640 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bfedc7d-495f-4487-81fb-3ddfc319f084-tls-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:30.349412 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.349412    5640 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-dshm\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:30.349412 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.349420    5640 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d61eb43d-3fb7-4791-9c05-2521348481ba-tls-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:30.349412 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.349428    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dd7b\" (UniqueName: \"kubernetes.io/projected/8bfedc7d-495f-4487-81fb-3ddfc319f084-kube-api-access-8dd7b\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:30.349842 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.349459    5640 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bfedc7d-495f-4487-81fb-3ddfc319f084-tmp-dir\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:30.349842 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.349470    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45f98\" (UniqueName: \"kubernetes.io/projected/d61eb43d-3fb7-4791-9c05-2521348481ba-kube-api-access-45f98\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:30.349842 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.349478    5640 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-home\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:30.349842 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.349487    5640 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d61eb43d-3fb7-4791-9c05-2521348481ba-tmp-dir\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:30.567860 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.567823    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"]
Nov 04 01:48:30.572036 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:30.571995    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-a96a99/distinct-2-w0-a96a99-kserve-7656cc9c79-fkx6l"]
Nov 04 01:48:31.159691 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:31.159659    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"
Nov 04 01:48:31.320853 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:31.320769    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"]
Nov 04 01:48:31.367145 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:31.367073    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-a96a99/simulator-w0-a96a99-kserve-67564cf55b-4n6qp"]
Nov 04 01:48:31.566726 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:31.566686    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8bfedc7d-495f-4487-81fb-3ddfc319f084" path="/var/lib/kubelet/pods/8bfedc7d-495f-4487-81fb-3ddfc319f084/volumes"
Nov 04 01:48:31.567381 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:31.567360    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d61eb43d-3fb7-4791-9c05-2521348481ba" path="/var/lib/kubelet/pods/d61eb43d-3fb7-4791-9c05-2521348481ba/volumes"
Nov 04 01:48:35.537036 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:35.537000    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"]
Nov 04 01:48:35.537540 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:35.537293    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j" podUID="1de203aa-f594-4c62-a8e6-2dc9c93a4b4d" containerName="maas-api" containerID="cri-o://d908d4f601942acd7cc7860d3613c9fa74b5fab43fd36854387b6fc42416d75c" gracePeriod=30
Nov 04 01:48:35.784317 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:35.784288    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"
Nov 04 01:48:35.816734 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:35.816649    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-metrics-certs\") pod \"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d\" (UID: \"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d\") "
Nov 04 01:48:35.816734 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:35.816700    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-kube-api-access-7n6nn\" (UniqueName: \"kubernetes.io/projected/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-kube-api-access-7n6nn\") pod \"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d\" (UID: \"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d\") "
Nov 04 01:48:35.816947 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:35.816739    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-maas-api-tls\") pod \"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d\" (UID: \"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d\") "
Nov 04 01:48:35.816947 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:35.816832    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-openshift-service-ca\") pod \"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d\" (UID: \"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d\") "
Nov 04 01:48:35.817333 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:35.817304    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-openshift-service-ca" pod "1de203aa-f594-4c62-a8e6-2dc9c93a4b4d" (UID: "1de203aa-f594-4c62-a8e6-2dc9c93a4b4d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:48:35.818860 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:35.818839    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-metrics-certs" pod "1de203aa-f594-4c62-a8e6-2dc9c93a4b4d" (UID: "1de203aa-f594-4c62-a8e6-2dc9c93a4b4d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:48:35.818929 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:35.818863    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-maas-api-tls" pod "1de203aa-f594-4c62-a8e6-2dc9c93a4b4d" (UID: "1de203aa-f594-4c62-a8e6-2dc9c93a4b4d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:48:35.818929 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:35.818869    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-kube-api-access-7n6nn" pod "1de203aa-f594-4c62-a8e6-2dc9c93a4b4d" (UID: "1de203aa-f594-4c62-a8e6-2dc9c93a4b4d"). InnerVolumeSpecName "kube-api-access-7n6nn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:48:35.918206 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:35.918177    5640 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-openshift-service-ca\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:35.918206 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:35.918203    5640 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-metrics-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:35.918400 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:35.918213    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7n6nn\" (UniqueName: \"kubernetes.io/projected/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-kube-api-access-7n6nn\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:35.918400 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:35.918224    5640 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d-maas-api-tls\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:36.189824 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:36.189737    5640 generic.go:356] "Generic (PLEG): container finished" podID="1de203aa-f594-4c62-a8e6-2dc9c93a4b4d" containerID="d908d4f601942acd7cc7860d3613c9fa74b5fab43fd36854387b6fc42416d75c" exitCode=0
Nov 04 01:48:36.189824 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:36.189789    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"
Nov 04 01:48:36.189824 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:36.189802    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j" event={"ID":"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d","Type":"ContainerDied","Data":"d908d4f601942acd7cc7860d3613c9fa74b5fab43fd36854387b6fc42416d75c"}
Nov 04 01:48:36.190123 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:36.189849    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j" event={"ID":"1de203aa-f594-4c62-a8e6-2dc9c93a4b4d","Type":"ContainerDied","Data":"d2f3de3a36cd17dfbcd2a602b048ed794983d3ff23addbec943a3ca1b95f35e8"}
Nov 04 01:48:36.190123 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:36.189874    5640 scope.go:122] "RemoveContainer" containerID="d908d4f601942acd7cc7860d3613c9fa74b5fab43fd36854387b6fc42416d75c"
Nov 04 01:48:36.198736 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:36.198715    5640 scope.go:122] "RemoveContainer" containerID="d908d4f601942acd7cc7860d3613c9fa74b5fab43fd36854387b6fc42416d75c"
Nov 04 01:48:36.199051 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:48:36.199022    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d908d4f601942acd7cc7860d3613c9fa74b5fab43fd36854387b6fc42416d75c\": container with ID starting with d908d4f601942acd7cc7860d3613c9fa74b5fab43fd36854387b6fc42416d75c not found: ID does not exist" containerID="d908d4f601942acd7cc7860d3613c9fa74b5fab43fd36854387b6fc42416d75c"
Nov 04 01:48:36.199142 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:36.199062    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d908d4f601942acd7cc7860d3613c9fa74b5fab43fd36854387b6fc42416d75c"} err="failed to get container status \"d908d4f601942acd7cc7860d3613c9fa74b5fab43fd36854387b6fc42416d75c\": rpc error: code = NotFound desc = could not find container \"d908d4f601942acd7cc7860d3613c9fa74b5fab43fd36854387b6fc42416d75c\": container with ID starting with d908d4f601942acd7cc7860d3613c9fa74b5fab43fd36854387b6fc42416d75c not found: ID does not exist"
Nov 04 01:48:36.342994 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:36.342936    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"]
Nov 04 01:48:36.347629 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:36.347599    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-a96a99-7d9d9f64d-krb9j"]
Nov 04 01:48:37.565166 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:37.565135    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1de203aa-f594-4c62-a8e6-2dc9c93a4b4d" path="/var/lib/kubelet/pods/1de203aa-f594-4c62-a8e6-2dc9c93a4b4d/volumes"
Nov 04 01:48:41.141390 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:48:41.141353    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:48:55.822511 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:55.822481    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"]
Nov 04 01:48:55.823019 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:55.822681    5640 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr" podUID="e06b964b-13a1-4914-aeb3-068f10ccf996" containerName="istio-proxy" containerID="cri-o://1c3c0ed62dc70d457052d76ad85b3461b7383c538b630bcb16ce6318c0419a67" gracePeriod=30
Nov 04 01:48:57.108704 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:48:57.108671    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8944767cb-69krk_d558a48a-4504-40e5-be72-98e3fdbc001e/authorino/0.log"
Nov 04 01:49:00.691915 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:00.691881    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-74b5554cc8-xwm2f_d231e576-1204-4dae-919d-bb176a2b9a01/manager/0.log"
Nov 04 01:49:01.071856 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.071830    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:49:01.166247 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.166217    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-envoy\") pod \"e06b964b-13a1-4914-aeb3-068f10ccf996\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") "
Nov 04 01:49:01.166395 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.166308    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-workload-socket\") pod \"e06b964b-13a1-4914-aeb3-068f10ccf996\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") "
Nov 04 01:49:01.166395 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.166359    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e06b964b-13a1-4914-aeb3-068f10ccf996-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e06b964b-13a1-4914-aeb3-068f10ccf996-istiod-ca-cert\") pod \"e06b964b-13a1-4914-aeb3-068f10ccf996\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") "
Nov 04 01:49:01.166521 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.166400    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-podinfo\") pod \"e06b964b-13a1-4914-aeb3-068f10ccf996\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") "
Nov 04 01:49:01.166521 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.166431    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-data\") pod \"e06b964b-13a1-4914-aeb3-068f10ccf996\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") "
Nov 04 01:49:01.166629 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.166527    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-credential-socket\") pod \"e06b964b-13a1-4914-aeb3-068f10ccf996\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") "
Nov 04 01:49:01.166629 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.166555    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-token\" (UniqueName: \"kubernetes.io/projected/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-token\") pod \"e06b964b-13a1-4914-aeb3-068f10ccf996\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") "
Nov 04 01:49:01.166629 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.166585    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-workload-certs\") pod \"e06b964b-13a1-4914-aeb3-068f10ccf996\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") "
Nov 04 01:49:01.166629 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.166615    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-workload-socket" pod "e06b964b-13a1-4914-aeb3-068f10ccf996" (UID: "e06b964b-13a1-4914-aeb3-068f10ccf996"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:49:01.166916 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.166644    5640 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e06b964b-13a1-4914-aeb3-068f10ccf996-kube-api-access-pgz9v\" (UniqueName: \"kubernetes.io/projected/e06b964b-13a1-4914-aeb3-068f10ccf996-kube-api-access-pgz9v\") pod \"e06b964b-13a1-4914-aeb3-068f10ccf996\" (UID: \"e06b964b-13a1-4914-aeb3-068f10ccf996\") "
Nov 04 01:49:01.166916 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.166825    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-credential-socket" pod "e06b964b-13a1-4914-aeb3-068f10ccf996" (UID: "e06b964b-13a1-4914-aeb3-068f10ccf996"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:49:01.166916 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.166836    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-data" pod "e06b964b-13a1-4914-aeb3-068f10ccf996" (UID: "e06b964b-13a1-4914-aeb3-068f10ccf996"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:49:01.166916 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.166848    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-workload-certs" pod "e06b964b-13a1-4914-aeb3-068f10ccf996" (UID: "e06b964b-13a1-4914-aeb3-068f10ccf996"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:49:01.167176 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.167109    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e06b964b-13a1-4914-aeb3-068f10ccf996-istiod-ca-cert" pod "e06b964b-13a1-4914-aeb3-068f10ccf996" (UID: "e06b964b-13a1-4914-aeb3-068f10ccf996"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:49:01.167176 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.167117    5640 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-credential-socket\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:49:01.167176 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.167162    5640 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-workload-certs\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:49:01.167343 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.167181    5640 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-workload-socket\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:49:01.167343 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.167195    5640 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-data\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:49:01.168697 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.168674    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-token" pod "e06b964b-13a1-4914-aeb3-068f10ccf996" (UID: "e06b964b-13a1-4914-aeb3-068f10ccf996"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:49:01.168815 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.168788    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-podinfo" pod "e06b964b-13a1-4914-aeb3-068f10ccf996" (UID: "e06b964b-13a1-4914-aeb3-068f10ccf996"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 01:49:01.168957 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.168938    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-envoy" pod "e06b964b-13a1-4914-aeb3-068f10ccf996" (UID: "e06b964b-13a1-4914-aeb3-068f10ccf996"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:49:01.169076 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.169048    5640 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e06b964b-13a1-4914-aeb3-068f10ccf996-kube-api-access-pgz9v" pod "e06b964b-13a1-4914-aeb3-068f10ccf996" (UID: "e06b964b-13a1-4914-aeb3-068f10ccf996"). InnerVolumeSpecName "kube-api-access-pgz9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:49:01.268340 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.268265    5640 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-token\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:49:01.268340 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.268296    5640 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgz9v\" (UniqueName: \"kubernetes.io/projected/e06b964b-13a1-4914-aeb3-068f10ccf996-kube-api-access-pgz9v\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:49:01.268340 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.268308    5640 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-envoy\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:49:01.268340 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.268316    5640 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e06b964b-13a1-4914-aeb3-068f10ccf996-istiod-ca-cert\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:49:01.268340 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.268325    5640 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e06b964b-13a1-4914-aeb3-068f10ccf996-istio-podinfo\") on node \"ip-10-0-131-51.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:49:01.308335 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.308299    5640 generic.go:356] "Generic (PLEG): container finished" podID="e06b964b-13a1-4914-aeb3-068f10ccf996" containerID="1c3c0ed62dc70d457052d76ad85b3461b7383c538b630bcb16ce6318c0419a67" exitCode=0
Nov 04 01:49:01.308500 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.308354    5640 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"
Nov 04 01:49:01.308500 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.308394    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr" event={"ID":"e06b964b-13a1-4914-aeb3-068f10ccf996","Type":"ContainerDied","Data":"1c3c0ed62dc70d457052d76ad85b3461b7383c538b630bcb16ce6318c0419a67"}
Nov 04 01:49:01.308500 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.308479    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr" event={"ID":"e06b964b-13a1-4914-aeb3-068f10ccf996","Type":"ContainerDied","Data":"ba84262fff49b5fcf2110350d1e71946e7bd7812e5c3df2cdcb003796fe6b500"}
Nov 04 01:49:01.308636 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.308503    5640 scope.go:122] "RemoveContainer" containerID="1c3c0ed62dc70d457052d76ad85b3461b7383c538b630bcb16ce6318c0419a67"
Nov 04 01:49:01.318180 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.318161    5640 scope.go:122] "RemoveContainer" containerID="1c3c0ed62dc70d457052d76ad85b3461b7383c538b630bcb16ce6318c0419a67"
Nov 04 01:49:01.318448 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:49:01.318430    5640 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c3c0ed62dc70d457052d76ad85b3461b7383c538b630bcb16ce6318c0419a67\": container with ID starting with 1c3c0ed62dc70d457052d76ad85b3461b7383c538b630bcb16ce6318c0419a67 not found: ID does not exist" containerID="1c3c0ed62dc70d457052d76ad85b3461b7383c538b630bcb16ce6318c0419a67"
Nov 04 01:49:01.318493 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.318457    5640 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c3c0ed62dc70d457052d76ad85b3461b7383c538b630bcb16ce6318c0419a67"} err="failed to get container status \"1c3c0ed62dc70d457052d76ad85b3461b7383c538b630bcb16ce6318c0419a67\": rpc error: code = NotFound desc = could not find container \"1c3c0ed62dc70d457052d76ad85b3461b7383c538b630bcb16ce6318c0419a67\": container with ID starting with 1c3c0ed62dc70d457052d76ad85b3461b7383c538b630bcb16ce6318c0419a67 not found: ID does not exist"
Nov 04 01:49:01.462522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.462490    5640 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"]
Nov 04 01:49:01.466883 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.466859    5640 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-s6cqr"]
Nov 04 01:49:01.564924 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:01.564894    5640 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e06b964b-13a1-4914-aeb3-068f10ccf996" path="/var/lib/kubelet/pods/e06b964b-13a1-4914-aeb3-068f10ccf996/volumes"
Nov 04 01:49:11.140468 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:49:11.140434    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:49:17.464414 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:17.464384    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8944767cb-69krk_d558a48a-4504-40e5-be72-98e3fdbc001e/authorino/0.log"
Nov 04 01:49:17.991950 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:17.991917    5640 scope.go:122] "RemoveContainer" containerID="2b787072acc544f323e365858288f22c945f847576b1ee8070e955ff0e2835ed"
Nov 04 01:49:40.222795 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:40.222763    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-74b5554cc8-xwm2f_d231e576-1204-4dae-919d-bb176a2b9a01/manager/0.log"
Nov 04 01:49:41.141027 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:49:41.140992    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:49:43.725226 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:43.725194    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-59b874c49c-hvkkd_a892880f-4481-4037-aa61-57626bd6afe5/maas-api/0.log"
Nov 04 01:49:46.936330 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:46.936300    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8944767cb-69krk_d558a48a-4504-40e5-be72-98e3fdbc001e/authorino/0.log"
Nov 04 01:49:50.975137 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:50.975101    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54cfc47d9b-6g2fd_f8b532d4-d727-4efb-8412-a8dc2ec308e3/kube-auth-proxy/0.log"
Nov 04 01:49:51.207987 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:51.207940    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5db77fbd9f-78bvs_dda960a4-2bd3-40bd-b9f4-992e6df421f4/istio-proxy/0.log"
Nov 04 01:49:52.236601 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:52.236568    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-jfjx2_456749d2-dacb-48e0-856f-bfe6c9a363c2/payload-pre-processing/0.log"
Nov 04 01:49:52.476840 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:52.476815    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-6prq8_3f4dde02-4142-4c05-9151-f0336873dde9/payload-processing/0.log"
Nov 04 01:49:53.803396 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:53.803365    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-k6pdf_60967951-4b72-42e1-ab0f-1165bb4a0cfa/main/0.log"
Nov 04 01:49:54.096204 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:54.096131    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-gqxkr_86003fc7-d47e-4c73-bf1d-3758e6e028f9/main/0.log"
Nov 04 01:49:54.339149 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:54.339115    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-n6pxb_aea686c2-6a33-47f2-bbbe-8e019648649f/main/0.log"
Nov 04 01:49:54.591266 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:54.591236    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-6f4h4_f4d765cf-971a-4596-b472-c32029e26ea8/main/0.log"
Nov 04 01:49:54.811468 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:54.811441    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mlswm_00152e02-0a5c-4f4e-be7c-6ad51d505557/main/0.log"
Nov 04 01:49:55.068205 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:55.068177    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-mjdhk_ab21243d-1380-4344-9ed8-3c5de602e47e/main/0.log"
Nov 04 01:49:55.605748 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:49:55.605721    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-t4rgv_4bc33a66-abf0-48fe-9e4f-4caef1dd2855/main/0.log"
Nov 04 01:50:11.140178 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:50:11.140142    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:50:16.498862 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.498829    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lz2tw/must-gather-vfppz"]
Nov 04 01:50:16.499262 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499201    5640 cpu_manager.go:414] "containerMap: removing container" podUID="88358137-e0c0-4b1b-8d07-a64187fcde9f" containerName="payload-pre-processing"
Nov 04 01:50:16.499262 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499212    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="88358137-e0c0-4b1b-8d07-a64187fcde9f" containerName="payload-pre-processing"
Nov 04 01:50:16.499262 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499228    5640 cpu_manager.go:414] "containerMap: removing container" podUID="8bfedc7d-495f-4487-81fb-3ddfc319f084" containerName="main"
Nov 04 01:50:16.499262 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499235    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8bfedc7d-495f-4487-81fb-3ddfc319f084" containerName="main"
Nov 04 01:50:16.499262 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499241    5640 cpu_manager.go:414] "containerMap: removing container" podUID="a9102582-6a31-4a75-af3d-07d643d55a02" containerName="maas-api"
Nov 04 01:50:16.499262 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499246    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a9102582-6a31-4a75-af3d-07d643d55a02" containerName="maas-api"
Nov 04 01:50:16.499262 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499252    5640 cpu_manager.go:414] "containerMap: removing container" podUID="31772fc6-bc9a-4d40-a587-914fffa131a6" containerName="istio-proxy"
Nov 04 01:50:16.499262 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499257    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="31772fc6-bc9a-4d40-a587-914fffa131a6" containerName="istio-proxy"
Nov 04 01:50:16.499262 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499265    5640 cpu_manager.go:414] "containerMap: removing container" podUID="e06b964b-13a1-4914-aeb3-068f10ccf996" containerName="istio-proxy"
Nov 04 01:50:16.499522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499270    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e06b964b-13a1-4914-aeb3-068f10ccf996" containerName="istio-proxy"
Nov 04 01:50:16.499522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499284    5640 cpu_manager.go:414] "containerMap: removing container" podUID="1de203aa-f594-4c62-a8e6-2dc9c93a4b4d" containerName="maas-api"
Nov 04 01:50:16.499522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499289    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1de203aa-f594-4c62-a8e6-2dc9c93a4b4d" containerName="maas-api"
Nov 04 01:50:16.499522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499305    5640 cpu_manager.go:414] "containerMap: removing container" podUID="d61eb43d-3fb7-4791-9c05-2521348481ba" containerName="main"
Nov 04 01:50:16.499522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499310    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d61eb43d-3fb7-4791-9c05-2521348481ba" containerName="main"
Nov 04 01:50:16.499522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499360    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="88358137-e0c0-4b1b-8d07-a64187fcde9f" containerName="payload-pre-processing"
Nov 04 01:50:16.499522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499370    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="8bfedc7d-495f-4487-81fb-3ddfc319f084" containerName="main"
Nov 04 01:50:16.499522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499375    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="a9102582-6a31-4a75-af3d-07d643d55a02" containerName="maas-api"
Nov 04 01:50:16.499522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499380    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="31772fc6-bc9a-4d40-a587-914fffa131a6" containerName="istio-proxy"
Nov 04 01:50:16.499522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499386    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="e06b964b-13a1-4914-aeb3-068f10ccf996" containerName="istio-proxy"
Nov 04 01:50:16.499522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499391    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="1de203aa-f594-4c62-a8e6-2dc9c93a4b4d" containerName="maas-api"
Nov 04 01:50:16.499522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499398    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="a9102582-6a31-4a75-af3d-07d643d55a02" containerName="maas-api"
Nov 04 01:50:16.499522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499404    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="d61eb43d-3fb7-4791-9c05-2521348481ba" containerName="main"
Nov 04 01:50:16.499522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499474    5640 cpu_manager.go:414] "containerMap: removing container" podUID="a9102582-6a31-4a75-af3d-07d643d55a02" containerName="maas-api"
Nov 04 01:50:16.499522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499479    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a9102582-6a31-4a75-af3d-07d643d55a02" containerName="maas-api"
Nov 04 01:50:16.499522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499484    5640 cpu_manager.go:414] "containerMap: removing container" podUID="31772fc6-bc9a-4d40-a587-914fffa131a6" containerName="istio-proxy"
Nov 04 01:50:16.499522 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499488    5640 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="31772fc6-bc9a-4d40-a587-914fffa131a6" containerName="istio-proxy"
Nov 04 01:50:16.500002 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.499541    5640 memory_manager.go:365] "RemoveStaleState removing state" podUID="31772fc6-bc9a-4d40-a587-914fffa131a6" containerName="istio-proxy"
Nov 04 01:50:16.502493 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.502475    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lz2tw/must-gather-vfppz"
Nov 04 01:50:16.556335 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.556301    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lz2tw/must-gather-vfppz"]
Nov 04 01:50:16.600819 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.600785    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lz2tw\"/\"kube-root-ca.crt\""
Nov 04 01:50:16.601041 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.600869    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lz2tw\"/\"openshift-service-ca.crt\""
Nov 04 01:50:16.601041 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.600932    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lz2tw\"/\"default-dockercfg-6dv9p\""
Nov 04 01:50:16.638543 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.638513    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/71146c95-50cb-4ca6-afcf-5ee2f48810bb-must-gather-output\") pod \"must-gather-vfppz\" (UID: \"71146c95-50cb-4ca6-afcf-5ee2f48810bb\") " pod="openshift-must-gather-lz2tw/must-gather-vfppz"
Nov 04 01:50:16.638734 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.638578    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6q9w\" (UniqueName: \"kubernetes.io/projected/71146c95-50cb-4ca6-afcf-5ee2f48810bb-kube-api-access-m6q9w\") pod \"must-gather-vfppz\" (UID: \"71146c95-50cb-4ca6-afcf-5ee2f48810bb\") " pod="openshift-must-gather-lz2tw/must-gather-vfppz"
Nov 04 01:50:16.739670 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.739626    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6q9w\" (UniqueName: \"kubernetes.io/projected/71146c95-50cb-4ca6-afcf-5ee2f48810bb-kube-api-access-m6q9w\") pod \"must-gather-vfppz\" (UID: \"71146c95-50cb-4ca6-afcf-5ee2f48810bb\") " pod="openshift-must-gather-lz2tw/must-gather-vfppz"
Nov 04 01:50:16.739856 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.739716    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/71146c95-50cb-4ca6-afcf-5ee2f48810bb-must-gather-output\") pod \"must-gather-vfppz\" (UID: \"71146c95-50cb-4ca6-afcf-5ee2f48810bb\") " pod="openshift-must-gather-lz2tw/must-gather-vfppz"
Nov 04 01:50:16.740052 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.740027    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/71146c95-50cb-4ca6-afcf-5ee2f48810bb-must-gather-output\") pod \"must-gather-vfppz\" (UID: \"71146c95-50cb-4ca6-afcf-5ee2f48810bb\") " pod="openshift-must-gather-lz2tw/must-gather-vfppz"
Nov 04 01:50:16.797390 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.797358    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6q9w\" (UniqueName: \"kubernetes.io/projected/71146c95-50cb-4ca6-afcf-5ee2f48810bb-kube-api-access-m6q9w\") pod \"must-gather-vfppz\" (UID: \"71146c95-50cb-4ca6-afcf-5ee2f48810bb\") " pod="openshift-must-gather-lz2tw/must-gather-vfppz"
Nov 04 01:50:16.816281 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:16.816259    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lz2tw/must-gather-vfppz"
Nov 04 01:50:17.199676 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:17.199601    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lz2tw/must-gather-vfppz"]
Nov 04 01:50:17.205952 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:50:17.205924    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71146c95_50cb_4ca6_afcf_5ee2f48810bb.slice/crio-ff1e65654435702b7ffbe5a724a485f44fdc2671280b2e241456c01faf2d2bd2 WatchSource:0}: Error finding container ff1e65654435702b7ffbe5a724a485f44fdc2671280b2e241456c01faf2d2bd2: Status 404 returned error can't find the container with id ff1e65654435702b7ffbe5a724a485f44fdc2671280b2e241456c01faf2d2bd2
Nov 04 01:50:17.207570 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:17.207551    5640 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 01:50:17.669329 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:17.669290    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lz2tw/must-gather-vfppz" event={"ID":"71146c95-50cb-4ca6-afcf-5ee2f48810bb","Type":"ContainerStarted","Data":"ff1e65654435702b7ffbe5a724a485f44fdc2671280b2e241456c01faf2d2bd2"}
Nov 04 01:50:24.711018 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:24.710960    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lz2tw/must-gather-vfppz" event={"ID":"71146c95-50cb-4ca6-afcf-5ee2f48810bb","Type":"ContainerStarted","Data":"e9ec06395ea0c34bc66aa075e12761838409fadecd98b061f975ba4b70ff1801"}
Nov 04 01:50:24.711391 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:24.711026    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lz2tw/must-gather-vfppz" event={"ID":"71146c95-50cb-4ca6-afcf-5ee2f48810bb","Type":"ContainerStarted","Data":"e8931ce64e67dcee990b0b52aef81d60ab9c544ba19f4189ccc746290a72eb9e"}
Nov 04 01:50:24.819853 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:24.819798    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-lz2tw/must-gather-vfppz" podStartSLOduration=2.086657905 podStartE2EDuration="8.819785244s" totalImagesPullingTime="6.733127339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:50:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:50:24.819275985 +0000 UTC m=+2347.371736111" watchObservedRunningTime="2026-11-04 01:50:24.819785244 +0000 UTC m=+2347.372245369"
Nov 04 01:50:27.370189 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:27.370084    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nrlb9_42e12e95-3cc8-4393-93fb-087e19f92874/global-pull-secret-syncer/0.log"
Nov 04 01:50:28.033132 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:28.033100    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-74b5554cc8-xwm2f_d231e576-1204-4dae-919d-bb176a2b9a01/manager/0.log"
Nov 04 01:50:30.250963 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:30.250938    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vktnk_39732b86-9f58-44ea-925e-a5e45c676586/konnectivity-agent/0.log"
Nov 04 01:50:31.211773 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:31.211743    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-51.us-west-2.compute.internal_a8e9fbe3308d7a9dc37557b42c180c40/haproxy/0.log"
Nov 04 01:50:32.924106 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:32.924071    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-74b5554cc8-xwm2f_d231e576-1204-4dae-919d-bb176a2b9a01/manager/0.log"
Nov 04 01:50:35.270938 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:35.270905    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8944767cb-69krk_d558a48a-4504-40e5-be72-98e3fdbc001e/authorino/0.log"
Nov 04 01:50:36.097550 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:36.097517    5640 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7"]
Nov 04 01:50:36.108143 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:36.108114    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7"
Nov 04 01:50:36.126841 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:36.126811    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5acae53a-e2b2-47e1-9c81-1083fded5647-podres\") pod \"perf-node-gather-daemonset-24wd7\" (UID: \"5acae53a-e2b2-47e1-9c81-1083fded5647\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7"
Nov 04 01:50:36.126996 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:36.126871    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5acae53a-e2b2-47e1-9c81-1083fded5647-sys\") pod \"perf-node-gather-daemonset-24wd7\" (UID: \"5acae53a-e2b2-47e1-9c81-1083fded5647\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7"
Nov 04 01:50:36.127092 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:36.127017    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz95f\" (UniqueName: \"kubernetes.io/projected/5acae53a-e2b2-47e1-9c81-1083fded5647-kube-api-access-zz95f\") pod \"perf-node-gather-daemonset-24wd7\" (UID: \"5acae53a-e2b2-47e1-9c81-1083fded5647\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7"
Nov 04 01:50:36.127092 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:36.127075    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5acae53a-e2b2-47e1-9c81-1083fded5647-lib-modules\") pod \"perf-node-gather-daemonset-24wd7\" (UID: \"5acae53a-e2b2-47e1-9c81-1083fded5647\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7"
Nov 04 01:50:36.127199 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:36.127115    5640 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5acae53a-e2b2-47e1-9c81-1083fded5647-proc\") pod \"perf-node-gather-daemonset-24wd7\" (UID: \"5acae53a-e2b2-47e1-9c81-1083fded5647\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7"
Nov 04 01:50:36.156731 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:36.156707    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pfwh8\"/\"kube-root-ca.crt\""
Nov 04 01:50:36.156851 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:36.156774    5640 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pfwh8\"/\"default-dockercfg-btrqg\""
Nov 04 01:50:36.203135 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:36.203103    5640 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pfwh8\"/\"openshift-service-ca.crt\""
Nov 04 01:50:36.204715 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:36.204692    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7"]
Nov 04 01:50:36.228270 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:36.228240    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5acae53a-e2b2-47e1-9c81-1083fded5647-lib-modules\") pod \"perf-node-gather-daemonset-24wd7\" (UID: \"5acae53a-e2b2-47e1-9c81-1083fded5647\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7"
Nov 04 01:50:36.228412 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:36.228283    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5acae53a-e2b2-47e1-9c81-1083fded5647-proc\") pod \"perf-node-gather-daemonset-24wd7\" (UID: \"5acae53a-e2b2-47e1-9c81-1083fded5647\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7"
Nov 04 01:50:36.228412 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:36.228354    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5acae53a-e2b2-47e1-9c81-1083fded5647-podres\") pod \"perf-node-gather-daemonset-24wd7\" (UID: \"5acae53a-e2b2-47e1-9c81-1083fded5647\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7"
Nov 04 01:50:36.228412 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:36.228388    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5acae53a-e2b2-47e1-9c81-1083fded5647-lib-modules\") pod \"perf-node-gather-daemonset-24wd7\" (UID: \"5acae53a-e2b2-47e1-9c81-1083fded5647\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7"
Nov 04 01:50:36.228579 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:36.228415    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5acae53a-e2b2-47e1-9c81-1083fded5647-sys\") pod \"perf-node-gather-daemonset-24wd7\" (UID: \"5acae53a-e2b2-47e1-9c81-1083fded5647\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7"
Nov 04 01:50:36.228579 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:36.228438    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5acae53a-e2b2-47e1-9c81-1083fded5647-proc\") pod \"perf-node-gather-daemonset-24wd7\" (UID: \"5acae53a-e2b2-47e1-9c81-1083fded5647\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7"
Nov 04 01:50:36.228579 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:36.228481    5640 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz95f\" (UniqueName: \"kubernetes.io/projected/5acae53a-e2b2-47e1-9c81-1083fded5647-kube-api-access-zz95f\") pod \"perf-node-gather-daemonset-24wd7\" (UID: \"5acae53a-e2b2-47e1-9c81-1083fded5647\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7"
Nov 04 01:50:36.228579 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:36.228487    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5acae53a-e2b2-47e1-9c81-1083fded5647-sys\") pod \"perf-node-gather-daemonset-24wd7\" (UID: \"5acae53a-e2b2-47e1-9c81-1083fded5647\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7"
Nov 04 01:50:36.228579 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:36.228459    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5acae53a-e2b2-47e1-9c81-1083fded5647-podres\") pod \"perf-node-gather-daemonset-24wd7\" (UID: \"5acae53a-e2b2-47e1-9c81-1083fded5647\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7"
Nov 04 01:50:36.286028 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:36.285995    5640 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz95f\" (UniqueName: \"kubernetes.io/projected/5acae53a-e2b2-47e1-9c81-1083fded5647-kube-api-access-zz95f\") pod \"perf-node-gather-daemonset-24wd7\" (UID: \"5acae53a-e2b2-47e1-9c81-1083fded5647\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7"
Nov 04 01:50:36.420645 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:36.420558    5640 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7"
Nov 04 01:50:36.793173 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:36.793142    5640 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7"]
Nov 04 01:50:36.800064 ip-10-0-131-51 kubenswrapper[5640]: W1104 01:50:36.800036    5640 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5acae53a_e2b2_47e1_9c81_1083fded5647.slice/crio-0f6bafc769b43d984420f2f5d31327b4c411fe910b1cb122b19a6c9280e9847b WatchSource:0}: Error finding container 0f6bafc769b43d984420f2f5d31327b4c411fe910b1cb122b19a6c9280e9847b: Status 404 returned error can't find the container with id 0f6bafc769b43d984420f2f5d31327b4c411fe910b1cb122b19a6c9280e9847b
Nov 04 01:50:37.774882 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:37.774850    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7" event={"ID":"5acae53a-e2b2-47e1-9c81-1083fded5647","Type":"ContainerStarted","Data":"5af655a7f3c3341fac4ef75dfc80b5c5eb63539528e757f75695618308cb1031"}
Nov 04 01:50:37.775311 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:37.774897    5640 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7" event={"ID":"5acae53a-e2b2-47e1-9c81-1083fded5647","Type":"ContainerStarted","Data":"0f6bafc769b43d984420f2f5d31327b4c411fe910b1cb122b19a6c9280e9847b"}
Nov 04 01:50:37.775311 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:37.774956    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7"
Nov 04 01:50:37.849133 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:37.849102    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-74b5554cc8-xwm2f_d231e576-1204-4dae-919d-bb176a2b9a01/manager/0.log"
Nov 04 01:50:37.883813 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:37.883765    5640 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7" podStartSLOduration=1.8837516399999998 podStartE2EDuration="1.88375164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:50:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:50:37.882471483 +0000 UTC m=+2360.434931615" watchObservedRunningTime="2026-11-04 01:50:37.88375164 +0000 UTC m=+2360.436211788"
Nov 04 01:50:40.863797 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:40.863749    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6b0c9a7e-e097-4ac1-90c9-ab5935c47d47/alertmanager/0.log"
Nov 04 01:50:41.140241 ip-10-0-131-51 kubenswrapper[5640]: E1104 01:50:41.140157    5640 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-mmvnr" containerName="extractor"
Nov 04 01:50:41.299753 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:41.299726    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6b0c9a7e-e097-4ac1-90c9-ab5935c47d47/config-reloader/0.log"
Nov 04 01:50:41.732945 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:41.732918    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6b0c9a7e-e097-4ac1-90c9-ab5935c47d47/kube-rbac-proxy-web/0.log"
Nov 04 01:50:42.166309 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:42.166284    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6b0c9a7e-e097-4ac1-90c9-ab5935c47d47/kube-rbac-proxy/0.log"
Nov 04 01:50:42.600109 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:42.600083    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6b0c9a7e-e097-4ac1-90c9-ab5935c47d47/kube-rbac-proxy-metric/0.log"
Nov 04 01:50:43.033185 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:43.033157    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6b0c9a7e-e097-4ac1-90c9-ab5935c47d47/prom-label-proxy/0.log"
Nov 04 01:50:43.470201 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:43.470134    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6b0c9a7e-e097-4ac1-90c9-ab5935c47d47/init-config-reloader/0.log"
Nov 04 01:50:43.793417 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:43.793384    5640 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-24wd7"
Nov 04 01:50:44.314956 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:44.314930    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54cfc47d9b-6g2fd_f8b532d4-d727-4efb-8412-a8dc2ec308e3/kube-auth-proxy/0.log"
Nov 04 01:50:44.354120 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:44.354098    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-lhm6f_db2a554a-660a-4b82-8e0e-70eaac7d1136/kube-state-metrics/0.log"
Nov 04 01:50:44.525981 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:44.525951    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5db77fbd9f-78bvs_dda960a4-2bd3-40bd-b9f4-992e6df421f4/istio-proxy/0.log"
Nov 04 01:50:44.783859 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:44.783838    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-lhm6f_db2a554a-660a-4b82-8e0e-70eaac7d1136/kube-rbac-proxy-main/0.log"
Nov 04 01:50:45.224131 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:45.224062    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-lhm6f_db2a554a-660a-4b82-8e0e-70eaac7d1136/kube-rbac-proxy-self/0.log"
Nov 04 01:50:45.371848 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:45.371825    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-jfjx2_456749d2-dacb-48e0-856f-bfe6c9a363c2/payload-pre-processing/0.log"
Nov 04 01:50:45.583727 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:45.583706    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-6prq8_3f4dde02-4142-4c05-9151-f0336873dde9/payload-processing/0.log"
Nov 04 01:50:45.667615 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:45.667591    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-77d5fd7b89-6zr4t_7906bfc4-e4b3-4025-bc1c-37aa0ba8e8fe/metrics-server/0.log"
Nov 04 01:50:47.874413 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:47.874383    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lc7jc_1f23f719-7430-4b54-9204-13d0c5bebf96/node-exporter/0.log"
Nov 04 01:50:48.307106 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:48.307083    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lc7jc_1f23f719-7430-4b54-9204-13d0c5bebf96/kube-rbac-proxy/0.log"
Nov 04 01:50:48.745924 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:48.745860    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lc7jc_1f23f719-7430-4b54-9204-13d0c5bebf96/init-textfile/0.log"
Nov 04 01:50:49.543832 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:49.543800    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8944767cb-69krk_d558a48a-4504-40e5-be72-98e3fdbc001e/authorino/0.log"
Nov 04 01:50:50.676163 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:50.676134    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-mqzrv_081d2b6e-a762-4015-8a75-a43b0f6c9e66/kube-rbac-proxy-main/0.log"
Nov 04 01:50:51.114798 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:51.114768    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-mqzrv_081d2b6e-a762-4015-8a75-a43b0f6c9e66/kube-rbac-proxy-self/0.log"
Nov 04 01:50:51.550718 ip-10-0-131-51 kubenswrapper[5640]: I1104 01:50:51.550685    5640 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-mqzrv_081d2b6e-a762-4015-8a75-a43b0f6c9e66/openshift-state-metrics/0.log"